summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* local.py: use extended source api for stagingtraveltissues/1161-4Darius Makovsky2019-10-221-13/+3
|
* workspace.py: use extended source api for stagingDarius Makovsky2019-10-221-25/+3
|
* Extend Source APIDarius Makovsky2019-10-222-1/+36
| | | | | | | Add `stage_into_directory()` and `stage_into_cas()` public methods. `stage_into_directory` reimplements `LocalSource.stage()` to import the source path on the specified directory object. `stage_into_cas()` calls this after obtaining a `CasBasedDirectory` for the import.
* Remove unused arg in _get_unique_keyDarius Makovsky2019-10-222-11/+5
|
* Merge branch 'chandan/register-pytest-mark' into 'master'bst-marge-bot2019-10-221-0/+1
|\ | | | | | | | | setup.cfg: Register mark for pytest-datafiles See merge request BuildStream/buildstream!1662
| * setup.cfg: Register mark for pytest-datafileschandan/register-pytest-markChandan Singh2019-10-221-0/+1
|/ | | | | | | | | | | | Register the marker for `pytest-datafiles`. This fixes the following warning that we currently get: ``` .tox/py37-nocover/lib/python3.7/site-packages/_pytest/mark/structures.py:324 /Users/csingh43/buildstream/bst-tmp/.tox/py37-nocover/lib/python3.7/site-packages/_pytest/mark/structures.py:324: PytestUnknownMarkWarning: Unknown pytest.mark.datafiles - is this a typo? You can register custom marks to avoid this warning - for detail s, see https://docs.pytest.org/en/latest/mark.html PytestUnknownMarkWarning, ```
* Merge branch 'traveltissues/1176' into 'master'bst-marge-bot2019-10-222-8/+18
|\ | | | | | | | | | | | | create usage monitor early Closes #1176 See merge request BuildStream/buildstream!1659
| * cascache.py: instantiate usage monitor earlyDarius Makovsky2019-10-222-8/+18
|/ | | | | | tests: manually close channels when interacting with the cache cascache.py: disable the usage monitor if start method is spawn
* Merge branch 'aevri/enable_spawn_ci_2' into 'master'bst-marge-bot2019-10-212-7/+22
|\ | | | | | | | | jobpickler: also pickle Digest protos See merge request BuildStream/buildstream!1652
| * gitlab: spawn tests, enable internals, sourcecacheaevri/enable_spawn_ci_2Angelos Evripiotis2019-10-211-1/+1
| | | | | | | | Now that more tests are passing, enable them.
| * jobpickler: also pickle DigestProtoAngelos Evripiotis2019-10-211-6/+21
|/ | | | | This is now required by some code paths. Also make a generic routine for pickling / unpickling, as we may be doing more of this.
* Merge branch 'aevri/enable_spawn_ci' into 'master'bst-marge-bot2019-10-184-10/+61
|\ | | | | | | | | Enable a subset of `tests-spawn-multiprocessing-start-method` See merge request BuildStream/buildstream!1650
| * .gitlab-ci.yml: disable most spawn testsaevri/enable_spawn_ciAngelos Evripiotis2019-10-181-0/+6
| |
| * cli: BST_FORCE_START_METHOD only sets if necessaryAngelos Evripiotis2019-10-181-10/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | Allow situations where the start method is already set, this enables us to use this in testing situations. Also, print a diagnostic if it's already set to something we didn't want. Now this block got more complex, split out into a new function. Now we're using this string a lot, extract it to a variable, to make sure we're spelling it correctly everywhere.
| * tests/conftest: implement BST_FORCE_START_METHODAngelos Evripiotis2019-10-181-0/+15
| |
| * tox.ini: pass through BST_FORCE_START_METHODAngelos Evripiotis2019-10-181-0/+1
|/ | | | Otherwise we won't actually be testing the spawn code path.
* Merge branch 'traveltissues/fix' into 'master'bst-marge-bot2019-10-181-3/+0
|\ | | | | | | | | element.py: remove unused variable See merge request BuildStream/buildstream!1658
| * element.py: remove unused variableDarius Makovsky2019-10-181-3/+0
|/
* Merge branch 'bschubert/bump-bst-experimental-version' into 'master'bst-marge-bot2019-10-182-2/+2
|\ | | | | | | | | | | | | .gitlab-ci.yml: Update bst-plugins-experimental version Closes #1174 See merge request BuildStream/buildstream!1656
| * .gitlab-ci.yml: Update bst-plugins-experimental versionbschubert/bump-bst-experimental-versionBenjamin Schubert2019-10-182-2/+2
|/ | | | Update to the plugins to work with the new YAML updates.
* Merge branch 'traveltissues/notes' into 'master'bst-marge-bot2019-10-183-48/+21
|\ | | | | | | | | workspaces via sourcecache MR2.5 See merge request BuildStream/buildstream!1653
| * Remove special loading for workspacestraveltissues/notesDarius Makovsky2019-10-173-48/+21
|/ | | | | WorkspaceSource.init_workspace raises an exception so it is no longer necessary to retain the original source objects of the loaded element.
* Merge branch 'traveltissues/1172' into 'master'bst-marge-bot2019-10-171-1/+1
|\ | | | | | | | | | | | | tox.ini: pin mypy 0.730 Closes #1172 See merge request BuildStream/buildstream!1649
| * tox.ini: pin mypy 0.730traveltissues/1172Darius Makovsky2019-10-171-1/+1
|/
* Merge branch 'traveltissues/1140-softreset' into 'master'bst-marge-bot2019-10-167-54/+101
|\ | | | | | | | | | | | | Workspaces via sourcecache MR 2 Closes #1140 See merge request BuildStream/buildstream!1640
| * tests: add test for soft workspace resettraveltissues/1140-softresetDarius Makovsky2019-10-161-0/+52
| |
| * Use workspace_close and workspace_open to reset workspacesDarius Makovsky2019-10-164-46/+42
| | | | | | | | | | | | | | | | | | | | | | | | | | * tracking not needed in reset * support workspace opening for already open workspaces remove existing files to preserve behaviour Add ignore_workspaces kwarg to element loading via Stream().load Setting this to true will ignore special handling of sources for open workspaces and load the sources specified rather than a workspace source. This avoids having to reload elements when re-opening workspaces.
| * _basecache.py: early return if remotes are setupDarius Makovsky2019-10-161-1/+3
| |
| * workspace.py: raise AssertionError on init_workspaceDarius Makovsky2019-10-161-7/+4
|/
* Merge branch 'bschubert/1.91.1' into 'master'1.91.1bst-marge-bot2019-10-161-0/+8
|\ | | | | | | | | NEWS: update release notes for version 1.91.1 See merge request BuildStream/buildstream!1646
| * NEWS: update release notes for version 1.91.1Benjamin Schubert2019-10-161-0/+8
|/
* Merge branch 'bschubert/yaml-tidying' into 'master'bst-marge-bot2019-10-1616-86/+77
|\ | | | | | | | | Some tidying up of our yaml API See merge request BuildStream/buildstream!1644
| * NEWS: add info about new YAML breaking changesBenjamin Schubert2019-10-161-0/+11
| |
| * node.pyx: Make 'strip_node_info' publicBenjamin Schubert2019-10-168-31/+31
| | | | | | | | | | 'strip_node_info' would be useful for multiple plugins. We should therefore allow users to use it.
| * element.py: Rework 'node_subst_list' to take the sequence directlyBenjamin Schubert2019-10-162-8/+7
| | | | | | | | Also rename it to 'node_subst_sequence_vars' to mimic 'node_subst_vars'.
| * element.py: remove 'node_subst_member' and replace with 'node_susbst_vars'Benjamin Schubert2019-10-163-37/+7
| |
| * element.py: Remove '_subst_string'Benjamin Schubert2019-10-161-15/+0
| | | | | | | | This is now unused. An alternative is 'node_subst_vars'.
| * _options/option.py: Pass the node instead of the str to 'transform'Benjamin Schubert2019-10-164-6/+9
| | | | | | | | | | | | | | This is in order to consolidate how we substitute variables. _project: use 'node_subst_vars' instead of '_subst_list' as the first one expects a node.
| * element.py: change 'substitute_variables' to take a 'ScalarNode' and renameBenjamin Schubert2019-10-162-7/+30
|/ | | | | | | | | Previously 'substitute_variable' would take a str, which would prevent us from doing nice error reporting. Using a 'ScalarNode' allows us to get our errors nicely. - rename it to 'node_subst_vars'. - add a nicer try-except around it in order to get nicer error reporting to users.
* Merge branch 'aevri/oldgit' into 'master'bst-marge-bot2019-10-161-1/+3
|\ | | | | | | | | testing/.../site: windows-friendly HAVE_OLD_GIT See merge request BuildStream/buildstream!1643
| * testing/.../site: windows-friendly HAVE_OLD_GITaevri/oldgitAngelos Evripiotis2019-10-151-1/+3
|/
* Merge branch 'juerg/prepare-fork' into 'master'bst-marge-bot2019-10-159-61/+45
|\ | | | | | | | | Replace is_fork_allowed() with prepare_fork() See merge request BuildStream/buildstream!1641
| * workspace.py: Do not close gRPC channelsJürg Billeter2019-10-152-5/+0
| | | | | | | | This is now handled in Context.prepare_fork().
| * _remote.py: Do not use subprocess to check remoteJürg Billeter2019-10-151-37/+6
| | | | | | | | This is no longer required as gRPC connections are closed before fork.
| * _context.py: Replace is_fork_allowed() with prepare_fork()Jürg Billeter2019-10-152-13/+10
| |
| * scheduler.py: Call is_fork_allowed() right before spawning jobsJürg Billeter2019-10-151-2/+7
| | | | | | | | | | gRPC channels might be opened after the scheduler has already been started. Make sure channels are closed right before spawning jobs.
| * _basecache.py: Add close_grpc_channels() methodJürg Billeter2019-10-151-3/+10
| |
| * cascache.py: Rename close_channel() to close_grpc_channels()Jürg Billeter2019-10-153-5/+5
| | | | | | | | This aligns the method name with has_open_grpc_channels().
| * cascache.py: Reset _casd_cas in close_channel()Jürg Billeter2019-10-151-0/+1
| |
| * _remote.py: Reset _initialized in close()Jürg Billeter2019-10-151-0/+2
| |