summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* dev-requirements.txt: Pin versions of pytest and pylintchandan/update-ci-tagsChandan Singh2018-08-211-1/+2
| | | | | | | | | | | | These packages should only be updated as a deliberate change and the code should be tested with the new versions to ensure that the test still pass. Any future updates should also happen in sync with the buildstream-docker-images repository so that the testsuite base images also enforce the same restrictions for the development requirements. Replaces https://gitlab.com/BuildStream/buildstream/merge_requests/684.
* .gitlab-ci.yml: Bump tags for testsuite imagesChandan Singh2018-08-211-6/+6
| | | | | | | These new images come with pinned versions of `pytest` and `pylint`: - `pylint`: `== 2.1.1` - `pytest`: `>= 3.7`
* Merge branch 'jonathan/faster-except-elements' into 'master'Jonathan Maw2018-08-211-0/+3
|\ | | | | | | | | Pipeline: Skip except_elements logic if no elements to except See merge request BuildStream/buildstream!688
| * Pipeline: Skip except_elements logic if no elements to exceptJonathan Maw2018-08-211-0/+3
|/
* Merge branch 'valentindavid/fix-broken-indentation-after-track' into 'master'Qinusty2018-08-214-6/+11
|\ | | | | | | | | Fix broken indentation after track See merge request BuildStream/buildstream!622
| * buildstream/_includes.py: Fix caching of included fragments.Valentin David2018-08-211-1/+1
| |
| * Fix broken indentation after tracking.Valentin David2018-08-214-5/+10
|/ | | | | | | | | Issue was introduced by 171e803f (include directive) and the fix was found courtesy of @Qinusty. This fixes also the include feature. Because elements are to be serialized, the included fragments need to use copy_tree when loaded. Related to #470.
* Merge branch 'jonathan/cascache-cell-var-from-loop' into 'master'Jonathan Maw2018-08-201-3/+3
|\ | | | | | | | | Jonathan/cascache cell var from loop See merge request BuildStream/buildstream!686
| * CASCache: Fix cell-var-from-loop linting errorJonathan Maw2018-08-201-3/+3
|/
* Merge branch 'jonathan/cache-cache-size' into 'master'Jonathan Maw2018-08-209-82/+195
|\ | | | | | | | | Jonathan/cache cache size See merge request BuildStream/buildstream!679
| * Add tests that cache size worksJonathan Maw2018-08-202-1/+63
| |
| * artifactcache: Read and write cache size to diskJonathan Maw2018-08-201-2/+53
| |
| * Fix get_cache_size to store it in the ArtifactCache, not the contextJonathan Maw2018-08-207-85/+80
| |
| * Use ArtifactCache's get_cache_size when calculating the quotaJonathan Maw2018-08-202-52/+57
|/ | | | | | It would have been more convenient to store the quota size in the ArtifactCache, except that the scheduler needs the quota size and doesn't have access to the ArtifactCache.
* Merge branch 'tristan/exclude-project-py-from-tests' into 'master'Tristan Van Berkom2018-08-201-1/+1
|\ | | | | | | | | setup.cfg: Add tests/integration/project to norecursedirs See merge request BuildStream/buildstream!682
| * setup.cfg: Add tests/integration/project to norecursedirsTristan Van Berkom2018-08-201-1/+1
|/ | | | | | This is causing pytest to try to import the recently added app1.py from the pip related tests. This fails because it's not meant to be imported outside of the sandbox environment.
* Merge branch 'Qinusty/531-fetch-retries-on-terminate' into 'master'Qinusty2018-08-171-2/+2
|\ | | | | | | | | | | | | Prevent jobs retrying on terminate Closes #531 See merge request BuildStream/buildstream!662
| * job.py: Prevent terminated jobs retryingJosh Smith2018-08-171-2/+2
|/ | | | | Fixes #531: Jobs were retrying when terminated, this lead to the process being spawned again and starting up fresh.
* Merge branch 'willsalmon/APIFix' into 'master'Will Salmon2018-08-177-31/+101
|\ | | | | | | | | Updating the no track or ref fix to match the buildstream style See merge request BuildStream/buildstream!628
| * Improve error message for build if there are refs missingwillsalmon/APIFixWilliam Salmon2018-08-171-14/+5
| |
| * Add Error to git and ostree sources configureWilliam Salmon2018-08-176-17/+96
|/ | | | | | | | | Raise a error at configure time if the track and ref properties are not present in the sources. This is to address https://gitlab.com/BuildStream/buildstream/issues/471 that documented unhelpful behaviour when tracking git sources. However the issue was also identified in ostree.
* Merge branch 'tristan/notifications' into 'master'Tristan Van Berkom2018-08-171-2/+14
|\ | | | | | | | | | | | | _frontend/app.py: Notify session completions Closes #385 See merge request BuildStream/buildstream!672
| * _frontend/app.py: Notify session completionsTristan Van Berkom2018-08-171-2/+14
|/ | | | | | | | | | Use the optionally implemented desktop notification method to notify when a session completes. Previously, this used to only notify when an interactive prompt appears. This is an attempt to fix #385
* Merge branch 'tiagogomes/issue-577' into 'master'Tiago Gomes2018-08-161-2/+4
|\ | | | | | | | | | | | | cascache: use errno module Closes #577 See merge request BuildStream/buildstream!674
| * cascache: use errno moduleTiago Gomes2018-08-161-2/+4
|/ | | | | | os.errno does no longer work with Python 3.7 Closes #577.
* Merge branch 'tiagogomes/disable-https-gnu-repo' into 'master'Tiago Gomes2018-08-161-1/+1
|\ | | | | | | | | Use http instead of https for the gnu ftp mirror See merge request BuildStream/buildstream!676
| * Use http instead of https for the gnu ftp mirrortiagogomes/disable-https-gnu-repoTiago Gomes2018-08-161-1/+1
|/ | | | | | | | | https seems broken on the Debian image: START autotools/hello/42930621-fetch.499.log START Fetching https://ftpmirror.gnu.org/gnu/automake/automake-1.16.tar.gz FAILURE Fetching https://ftpmirror.gnu.org/gnu/automake/automake-1.16.tar.gz FAILURE tar source at hello.bst [line 16 column 2]: Error mirroring https://ftpmirror.gnu.org/gnu/automake/automake-1.16.tar.gz: <urlopen error [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:720)>
* Merge branch 'willsalmon/CacheExpiryTest' into 'master'Tom Pollard2018-08-165-3/+133
|\ | | | | | | | | Trying to mitigate a file system issue See merge request BuildStream/buildstream!595
| * Trying to mitigate a mtime granularity braking the cache testswillsalmon/CacheExpiryTestWilliam Salmon2018-08-165-3/+133
|/ | | | | This patch mitigates the granularity of the mtimes used on the default gitlab runners, Allowing the test suite to pass on these runners.
* Merge branch 'valentindavid/fallback_mirror_ostree' into 'master'Tristan Van Berkom2018-08-162-14/+20
|\ | | | | | | | | | | | | Fix ostree repository mirroring Closes #538 See merge request BuildStream/buildstream!658
| * Fix ostree repository mirroringValentin David2018-08-162-14/+20
|/ | | | | | | | | | | Ostree mirrors were not sharing the same local repository, so it was impossible the request refs from the right local repository when data was fetched from a mirror rather than upstream. Instead of having several repository with one remote each, we now have one repository with several remotes. This fixes #538.
* Merge branch 'chandan/sourcetransform' into 'master'Chandan Singh2018-08-1531-58/+794
|\ | | | | | | | | | | | | Allow source plugins to access previous sources Closes #381 See merge request BuildStream/buildstream!568
| * Add NEWS entry for Source Transform and pip sourcechandan/sourcetransformChandan Singh2018-08-151-0/+7
| |
| * Add pip source pluginChandan Singh2018-08-1522-6/+454
| | | | | | | | | | | | | | | | | | | | | | `pip` source plugin can stage python packages that are either specified directly in the element definition or picked up from `requirements.txt` from previous sources. In order to support the latter use-case (which is also the primary motivation for this plugin), this plugin requires access to previous sources and hence is an example of a Source Transform source. Also, bump `BST_FORMAT_VERSION` as this patch adds a new core plugin.
| * Allow source plugins to access previous sourcesChandan Singh2018-08-159-56/+337
|/ | | | | | | | | | | | | Source plugin implementations can now specify that they need access to previously staged sources by specifying `BST_REQUIRES_PREVIOUS_SOURCES_TRACK` and/or `BST_REQUIRES_PREVIOUS_SOURCES_FETCH`, corresponding to access at `track` and `fetch` times respectively. Fixes #381. Replaces !505. For relevant discussion, see this discussion: https://gitlab.com/BuildStream/buildstream/merge_requests/505#note_83780747
* Merge branch 'jmac/cas_virtual_directory' into 'master'Jim MacArthur2018-08-1515-59/+743
|\ | | | | | | | | CAS-backed virtual directory implementation See merge request BuildStream/buildstream!481
| * Add basic storage test 'storage-test.py'jmac/cas_virtual_directoryJim MacArthur2018-08-154-0/+60
| |
| * Sandbox: Return a CasBasedDirectory when an environment variable is setJim MacArthur2018-08-151-2/+10
| |
| * filebaseddirectory: Update index after descendJim MacArthur2018-08-151-1/+2
| |
| * Directory API: add mark_changedJim MacArthur2018-08-154-0/+16
| |
| * Initial implementation of _casbaseddirectory.pyJim MacArthur2018-08-151-0/+563
| |
| * Move KeyStrength enum out to element_enums.pyJim MacArthur2018-08-154-38/+67
| |
| * _filebaseddirectory/directory.py: Move VirtualDirectoryError to DirectoryJim MacArthur2018-08-152-15/+15
| |
| * Convert uses of external_directory to get_underlying_directory()Jim MacArthur2018-08-153-3/+10
|/
* Merge branch 'juerg/cas' into 'master'Jürg Billeter2018-08-152-17/+78
|\ | | | | | | | | | | | | CAS: Fix resource_name format for blobs Closes #572 See merge request BuildStream/buildstream!660
| * _artifactcache/casserver.py: Improve ByteStream error handlingJürg Billeter2018-08-151-19/+52
| | | | | | | | Replace assertions with gRPC error responses.
| * _artifactcache/cascache.py: Fix resource_name format for blobsJürg Billeter2018-08-151-2/+6
| | | | | | | | | | | | This requires an updated server. Fixes #572.
| * _artifactcache/casserver.py: Fix resource_name format for blobsJürg Billeter2018-08-151-6/+30
|/ | | | | Continue to accept requests from non-conforming BuildStream clients for the time being to ease migration.
* Merge branch 'Qinusty/526-fail-on-warnings' into 'master'Tristan Van Berkom2018-08-1544-83/+398
|\ | | | | | | | | | | | | Configurable Warnings Closes #526 See merge request BuildStream/buildstream!627
| * tests: Add tests for configurable warningsJosh Smith2018-08-159-2/+201
| | | | | | | | | | | | | | | | This adds multiple tests for custom plugin warnings and core warnings, providing checks for both cases which should cause warnings and errors when configured as fatal. Also adds tests for cache key calculations.