summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* tests/pipeline/preflight.py: Added test to ensure graceful exit at preflight ↵fix-preflight-errorsTristan Van Berkom2018-01-065-0/+69
| | | | error time
* _pipeline.py: Raise detailed pipeline error at preflight timeTristan Van Berkom2018-01-061-2/+11
| | | | | If a plugin raises an error, prepend the plugin identifier to the error message and raise PipelineError.
* _frontend/main.py: Fix issue #180 - Fail gracefully when preflight failsTristan Van Berkom2018-01-061-21/+18
| | | | | | | This also makes main.py less redundant, for some reason there was a stray call to app.pipeline.initialize() beside app.initialize() in every function, instead move that into app.initialize() where we now handle the error and exit gracefully.
* local & patch source tests: Preflight errors now report PipelineErrorTristan Van Berkom2018-01-062-3/+3
|
* tests/testutils/runcli.py: Assert that buildstream actually exited.Tristan Van Berkom2018-01-061-0/+12
| | | | | | Enhanced the error checking Result() methods to always assert that the CLI actually exited, there are no cases worth testing for where buildstream would be expected to exit on an unhandled exception.
* tests/pipeline/load.py: Removing unused tmpdir fixture from hereTristan Van Berkom2018-01-061-7/+7
|
* test/utils/savefile.py: Stringify the tmpdir so that tests work.fix-savefile-test-brokenTristan Van Berkom2018-01-061-9/+9
| | | | | | | | | It looks like this newly added test assumes the user has a very recent version of pytest, which supports treating the `tmpdir` fixture like a string. A reasonable alternative to this patch would be require at minimum a version of pytest which supports this newly introduced API.
* doc/source/install.rst: You need python3-ruamel-yaml package in Fedorajjardon/doc_install_fedoraJavier Jardón2018-01-051-1/+1
|
* Documentation: Removing the sphinx-build3 scriptTristan Van Berkom2018-01-052-32/+13
| | | | | Instead add a comment about why this is really there, and invoke sphinx python modules with python3 directly.
* Documentation: Fix warnings, and make all warnings errors.Tristan Van Berkom2018-01-0516-2/+31
| | | | | | | | | | Some of the warnings from sphinx-build are really just warnings, but a lot of the things we want to avoid and really break documentation, like broken internal references and some invalid rst directives should really be errors. Now we treat all warnings as errors, this should ensure that any commits landing upstream never break the docs.
* _yaml.py: Use save_file_atomic() when writing out YAMLsam/savefile-utilitySam Thursfield2018-01-041-1/+2
| | | | | | This makes writes done by `bst track` atomic, meaning a crash or power loss while overwriting a .bst file should never cause the the contents of that file to be lost or partially written.
* Move utils._generate_key() into a new 'cachekey' moduleSam Thursfield2018-01-045-23/+50
| | | | | This avoids a circular dependency between the 'utils' and '_yaml' modules.
* Use save_file_atomic() when writing source-bundle scriptsSam Thursfield2018-01-042-2/+2
|
* utils.py: Add save_file_atomic() helperSam Thursfield2018-01-043-0/+120
| | | | | | | | | | | | This is a context manager that can be used to divert file writes into a temporary file, which is then renamed into place once writing is complete. It is primarily intended for use by source plugins which download files, so they can ensure that their downloads appear atomic and there is no risk of leaving half-downloaded files in the cache. So far this is not used in the core, but it is needed by the Docker source plugin that is proposed for the bst-external plugins repo. See: https://gitlab.com/BuildStream/bst-external/merge_requests/9
* doc/source/install.rst: Silence a docs generation errorTristan Van Berkom2018-01-041-2/+2
| | | | | | Fixes the warning: WARNING: /path/to/buildstream/doc/source/install.rst:45: (WARNING/2) Title underline too short.
* source.py & element.py: Fixing SourceError() and ElementError() constructors.Tristan Van Berkom2018-01-042-6/+12
| | | | | | | | Recently I added the `reason` member which can be used to set machine readable error reason strings for the purpose of testing. Forgot to add the necessary `*` argument, forcing `reason` to be a keyword-only argument.
* setup.py: Removing explicitly set version, we use setuptools_scm for this.Tristan Van Berkom2018-01-031-1/+0
|
* Added MAINTAINERS, NEWS and BuildStream.doap1.0.0Tristan Van Berkom2018-01-034-2/+60
| | | | Some basic module metadata before publishing the 1.0 release.
* .gitlab-ci.yml: Force colors in pytest for better output in the gitlab UI.error-codesTristan Van Berkom2018-01-021-0/+3
|
* plugins/sources/_downloadablefilesource.py: Exclude a line from coverageTristan Van Berkom2018-01-021-1/+6
| | | | | | | When fetching a downloadable source, we make a defensive check to avoid redundant download at fetch() time by checking if it's already cached, but fetch() will never be called if the source is already cached.
* tests/sources/local.py: Adding test for staging a symlink.Tristan Van Berkom2018-01-024-0/+34
| | | | | This has remained without test coverage mostly due to upstream pytest-datafiles bug https://github.com/omarkohl/pytest-datafiles/issues/1
* tests/sources/local.py: Testing failures to create staging directoriesTristan Van Berkom2018-01-024-0/+28
| | | | | | | | Seems that local.py is an appropriate plugin to use for testing errors which originate from the abstract Source class. This test checks that we raise the appropriate error in the case that we attempt to stage to a directory that is a regular file.
* plugins/sources/local.py: pragma nocover on unreachable codeTristan Van Berkom2018-01-021-3/+3
| | | | | | | | The local plugin is always Consistency.CACHED, this means that fetch(), set_ref() and get_ref() methods will never be called. Instead of omitting them, just "pragma: nocover" on the `pass` statements, making our coverage report more realistic.
* plugins/sources/patch.py: Removing unneeded checkTristan Van Berkom2018-01-021-7/+5
| | | | | | | | | The patch plugin was checking if the target directory exists, however this is automatically guaranteed by the Source abstract class and documented to be guaranteed as well. Since this error cannot be caught by the plugin (it will be caught in advance by the Source class), removing the check from patch.py.
* source.py: Raise proper SourceError() when failing to create the staging ↵Tristan Van Berkom2018-01-021-1/+7
| | | | | | | directory This changes the UX to report a better human readable error, which is otherwise a BUG message with stack trace.
* tests/frontend: Updating tests to use new error checksTristan Van Berkom2018-01-0112-57/+50
| | | | | This also fixes #177 - the problem here was solved simply by passing the project directory to `cli.run(project=project...)`
* tests/format: Use new error assertions all aroundTristan Van Berkom2018-01-0111-120/+50
|
* tests/cachekey/cachekey.py: Use new error checkingTristan Van Berkom2018-01-011-5/+1
|
* tests/sources: Use new error checking tools for source testsTristan Van Berkom2018-01-016-82/+91
| | | | | | Also added a test case for the `patch` plugin which checks for graceful failure when the specified patch file is not a regular file (but a block device or a named pipe instead).
* tests/testutils/runcli.py: Augment the Result object to store task errorsTristan Van Berkom2018-01-011-9/+100
| | | | | | | | | | | | Before this, we only stored the last exception to have been raised in the main process, now we additionally provide some Result members allowing tests to inspect a machine readable error `domain` and `reason` describing why a task has "failed". This adds some new APIs to the Result() object for tests: assert_main_error() - asserts the nature of the main buildstream error assert_task_error() - asserts the nature of the error from a child task
* plugins/sources/patch.py: Added context to some errorsTristan Van Berkom2018-01-011-8/+12
|
* _pipeline.py: Added context to some errorsTristan Van Berkom2018-01-011-1/+1
|
* Exceptions refactoringTristan Van Berkom2017-12-296-24/+100
| | | | | | | | | | | | | | | Outline of changes to exceptions: o Now BstError base class has a `domain` and `reason` member, reason members are optional. o All derived error classes now specify their `domain` o For LoadError, LoadErrorReason defines the error's `reason` o Now the scheduler `job` class takes care of sending the error reason and domain back to the main process where the last exception which caused a child task to fail can be discretely stored.
* .gitlab-ci.yml: Build documentation in every CI pipelineci-on-docsTristan Van Berkom2017-12-221-24/+58
| | | | | Build it in one stage before the `pages` target, and then only make the deployment step conditional on the branch.
* _signals.terminator_handler: wrap handlers in trysAngelos Evripiotis2017-12-221-1/+14
| | | | | | | | It's possible for the custom termination handlers to raise exceptions. Indeed this was actually the case for utils._call(). They're especially difficult to reach with tests, so make extra effort to insulate them. Print any exceptions encountered as a regular traceback before exiting.
* utils._call: rm unused assignments to exit_codeAngelos Evripiotis2017-12-221-2/+1
|
* utils._call: fix race condition on 'process' varAngelos Evripiotis2017-12-221-0/+2
| | | | | | | | | | Tested by inflating the chance of hitting the race. First, insert a sleep between opening the terminator context and starting the process, then: python3 -c 'import buildstream.utils; import os; \ buildstream.utils._call(["echo", "hello"], True); \ print(os.getpid())' & sleep 1; kill $!
* utils._call: fix doc typoAngelos Evripiotis2017-12-221-1/+1
|
* .gitlab-ci.yml: Use latest BuildStream Docker imageSam Thursfield2017-12-211-1/+1
| | | | | Integration tests were failing as the installed version of BuildStream didn't support the new --hardlinks option.
* plugins/sources/tar.py: Dont manually reraise exceptionTristan Van Berkom2017-12-201-5/+4
| | | | | It's not required to raise SourceError() manually when calling utils.get_host_tool().
* Fixing tests to adapt to new setup of ProgramNotFound exceptionTristan Van Berkom2017-12-202-6/+4
|
* _artifactcache/tarcache.py: Fixed for new location of ProgramNotFoundErrorTristan Van Berkom2017-12-201-2/+2
|
* utils.py: Add UtilErrorTristan Van Berkom2017-12-203-52/+84
| | | | | | | | | | | | | | | | | Report UtilError instead of OSError and similar python errors. Also ensure we catch system errors and raise UtilError with descriptive text instead; for the user experience; this is the difference between: o A FAILURE message with a description as to what went wrong (exception handled with UtilError) o A BUG message with the unhandled system error printed with a stack trace (exception left unhandled) Also, UtilsError and ProgramNotFoundError are now public exceptions declared in utils.py, where they will appear in the documentation.
* project: Export the name as a variableproject-nameMathieu Bridon2017-12-201-0/+3
| | | | | This is often useful, for example when the main element needs to do something with a path like /etc/%{project-name}/ .
* Fix a "TypeError: 'dict' object is not callable" in _plugincontext.pyValentin David2017-12-201-1/+1
|
* doc: Add cache key documentationjuerg/cache-key-docJürg Billeter2017-12-202-0/+100
|
* project: Rename required-project-version to format-versionJonathan Maw2017-12-143-5/+5
|
* project: Reduce code duplication when storing originsJonathan Maw2017-12-141-25/+33
|
* doc: Remove stray documentation of obsolete required-versions fieldsJonathan Maw2017-12-141-18/+0
|
* _plugincontext.py: Let plugins not have YAML defaultsMathieu Bridon2017-12-141-4/+8
| | | | | Source plugins typically do not have an accompanying YAML file with their default settings.