summaryrefslogtreecommitdiff
path: root/strata/morph-utils.morph
Commit message (Collapse)AuthorAgeFilesLines
* strata/morph-utils.morph: Upgrade morph to latestJavier Jardón2015-10-071-1/+1
| | | | Change-Id: I08891e20fc8172ff2a4e9171c87f21f10dc019cf
* Migrate to definitions format version 6Sam Thursfield2015-08-261-0/+3
| | | | Change-Id: I3845c77e8872ce2e1e8bc6a60e3ce7f184c32f58
* Update to latest release of ruamel.yamlSam Thursfield2015-08-261-7/+2
| | | | | | | This version fixes an assertion failure when running the definitions migrations scripts. Change-Id: If96a5d6bf8376b684d418e621b5d419541fdbe31
* Update Morph build tool in reference systemsSam Thursfield2015-07-291-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This includes the following changes: Add support for Baserock definitions version 6 Remove support for Baserock definitions format versions 0, 1 and 2 Don't provide default strip-commands for 'manual' build system Extract downloaded tarball as current user Add bitbucket repo alias to default aliases sourceresolver_tests: Remove bogus test sourceresolver_tests: Fix invalid backup definition distbuild: Fix cache status message distbuild: Fix crash when worker disconnects distbuild: Fix partial distbuilding distbuild: Add __str__() and __repr__() to ArtifactReference distbuild: Hide a log message distbuild: Check cache status each time we enqueue new artifacts distbuild: Add docstrings to BuildController state machine Fix crash in `morph distbuild` command Make `morph show-build-log` look in local repo cache for build logs Make more commands work outside a system-branch/workspace Determine whether to include_local_changes from app.settings Raise exception if show-build-log doesn't find the build log Fix `morph show-build-log` for chunks of a different architecture localrepocache: Count freshly cloned repositories as updated Fix anchor yarn Add script to run a distbuild network on the local machine Don't ignore the 'cwd' parameter Expose reset_workdir in GitDirectory class Swap repr() for str() in ref add errmsg Improve error when local HEAD of definitions repo is not found in remote Use DefinitionsRepo class in deploy plugin Use DefinitionsRepo in build command Add DefinitionsRepo class Treat True and False as actual commands, rather than booleans. buildsystem: Comment strip command Change-Id: Ic55e12bfe5e98f4a1a4df875c23ad3d447f7038c
* Add ruamel.yaml library to 'build' and 'devel' systemsSam Thursfield2015-07-191-0/+12
| | | | | | | | | | | | This is currently done by adding it to the 'morph-utils' stratum, because it is used as a tool for working with .morph files. The ruamel.yaml library allows writing YAML files while preserving comments, ordering and some formatting form the input files. This makes it more practical for us to write automated migration scripts for Baserock definitions. Change-Id: I886232dad4d64bcf1803f52e94ae25b0fa2d9969
* Update the version of morph in definitionsAdam Coldrick2015-06-121-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This gets the following changes: 2579391 buildsystem: Comment strip command 7f2ccd3 sourceresolver: Support version 5 c80c676 Set PYTHONPATH when running deployment extensions d95bd9e cachekey/builder: Use and cache strip commands acdc5ce sourceresolver: Use versioned morphology loader afee581 morphloader: Smoke test strip command inclusion 600f264 morphloader: Allow build-system lookup to be customised de977c0 morphloader: When given definitions v5, include strip commands 15da1e3 buildsystems: Add strip commands 0feb10b sourceresolver: Re-order method definitions in use order 4ceaa8c sourceresolver: Pass all hidden state 117413f Fix test suite d8e7abe CacheKeyComputer: Only attempt to include commands present in morphology 0ed681e morphloader: Hoist buildsystem lookup outside of loops 22232a8 morphloader: Add test-commands to key order 7f3b39d sourceresolver: bind util.sanitise_morphology_path 8101068 sourceresolver: Remove cache_repo_locally 4ed27e0 sourceresolver: Use context managers for cleanup and cache writeback d873baa morphlib: Use new temp_dir helper context manager 061834b morphlib.util: Add temp_dir context manager eb3eb47 sourceresolver: Pass build system directly to morphology creation e7027e5 Add separate_mount_namespace kwarg to ext runner 56c7db5 Do not call str() on None types in sanitize_env 7929082 Ignore the configuration extensions when generating the cache-key 501181a Use keystoneclient python api in openstack.check 9a831cc deploy: Don't imply --upgrade in subsystems 87bfac4 morph deploy: Allow overriding UPGRADE in definition or on command line 4ce4366 Ignore --upgrade flag rather than exiting 05b2b06 Move 'git config' wrapper into its own class 5387806 check: Allow yarns to be run with --snapshot 4e07f7e yarns: Fix typo in cross-bootstrap yarn 31ddf5d yarns: Add a test for `morph list-artifacts` 8eef287 yarns: Add a test for `morph certify` 4dcc23b yarns: Add a test for `morph generate-manifest-csv` 6fd766d generate-manifest-csv: Catch NoRemote error when cloning lorries repo f72b4dc Give exact filename when an artifact is not found in the cache. 5dd1f23 Use protocol to validate incoming requests ddef6ab Disable WC exec-output messages in log by default 88967bf Disable logging of build output by default c373f5a Bump supported definitions version to version 4 4131947 distbuild: Handle errors from socket 8625124 distbuild: Condense Initiator class to remove unnecessary duplication 2c2b113 Add .gitreview file 2607fa3 Fix crash in handling of recursive submodules Change-Id: Ib7e2db60a9ec4f6196e6a4b4ecd53ed9b0b0c3cc
* Update MorphSam Thursfield2015-05-151-1/+1
| | | | | | | | | For these changes: 1da8ee6 Fix prototype of create_source_pool() d7e8604 Protocol check fix Change-Id: I80b14ca81a04c64a60f4332059927ffdc097d22e
* Update MorphSam Thursfield2015-05-121-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | This includes the following changes: eda5cb2 Explain how to cancel a distbuild eb9e43d distbuild: Set job status to failed when sending exec-cancel 43fed1e Revert "distbuild: Track worker jobs using artifact basename only" aa19fb9 Remove mention of MorphologyFactory in the unit tests 9cc12c9 Clean up artifact serialisation 2d19611 Move duplicate fix_chunk_build_mode function to a common location 1c45305 Enable native-bootstrap to continue build after recovered from fault. fdd6aeb Remove % from debug statement 733d6f9 Add a common func for handling build termination f4360e3 Add GraphProgress messages cc79a6b distbuild: Fix protocol version checking for distbuild commands 5aa34de yarns: Add yarn for morph diff 2d2774a yarns: Add the ability to tag chunks and commit updates to definitions e2e2ede morph: Add morph diff subcommand 812492d morphlib: Add utility module for parsing argv into lists of systems d22a4a2 distbuild: Builds currently break due to job being set twice 4cc7503 SourceResolver: Allow the resolution of multiple systems 43ae0cc LRC: Make get_updated_repo handle multiple refs 5f48a25 MorphologyLoader: Set filename attribute at parse time af5866c morph anchor: Handle updating refs 6aec7d7 morphlib.util: add word_join_list 7fe5c48 yarns: Fix incorrect chunk name in test suite Change-Id: Iaffcdd506dac6a31f1a11d9218afcb7f31b26758
* Update MorphSam Thursfield2015-05-081-1/+1
| | | | | | | Changes: 524b17f Fix mistake in sysroot.write f9a0607 Raise an error if a stratum build-depends on itself
* Update Morph to fix `distbuild-morphology` commandSam Thursfield2015-05-071-1/+1
|
* Update Morph for various new changesSam Thursfield2015-05-071-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Full list: 0b2b24a distbuild: Fix initiator hanging when protocol errors occur f6e3627 Fix sysroot.write trying to overwrite existing files e08f3e3 distbuild: Allow WorkerConnection to track multiple in-flight jobs 75ef3e9 distbuild: Track worker jobs using artifact basename only be3383e distbuild: Track state of a job in the Job class 44917b2 distbuild: Make Jobs class into a more generic JobQueue 42b915c Make str() of a GitDirectory return its location. 6db8c4f Make listing contents of local tarball cache more robust 07a0b83 Show progress of downloads when --verbose is passed, not --debug 11391bc GitDir: Fix setting fetch url when push url is already on-disk 534fe7a Update distbuild protocol version to 3 a030d42 Add yarns for basic `morph anchor` functionality 8956e5e Add `morph anchor` command b477acb yarns: Fix typo in system branch creation yarn f4ec3d2 yarns: Fix get-repo test falsely checking exit result eaa0685 RemoteRefManager: Fail all ref updates when one fails 2904830 GitDir: Set the fetch or push url when the other is set 9e074be yarns: Have non-bogus trove config 1f66776 CachedRepo: Fix reference to _gitdir 93b034f install-files.configure: make possible to overwrite symlinks 7e5bab5 Add a test for partial deployment 1d57b19 Allow the deployment of individual chunks/strata from systems 2985a46 morphlib: Add command to get build-log for a given chunk and system file 9867774 Add ssh keys conf ext 74ac75d Fix partial distbuilds of non-existant components f964cf0 Add a CSV manifest generator. 5ea105a Check number of args given to build commands 34870ac Improve 'Deploy failed as system is not yet build' error. c9ebfbf GitDirectory: Add a store_commit method ae17229 gitdir.PushFailureError: Show why pushes failed f489767 CachedRepo: Expose the internal gitdir object 7bf8fda morph help: Expand upon the importance of the first trove-id 442e62c Install licensecheck.pl with morphlib dd755f8 Ignore BuildProgress messages ac6d189 Remove n_state_machines_of_type function 4941d1d distbuild: Add distbuild status command 8409655 distbuild: Add distbuild start and cancel functionality 4a1c2d1 distbuild: Add protocol version checking for list-jobs command 8875e9c Bump supported definitions format version to 3 Change-Id: Ic827f1024ad4491938b5b0bfc1f2971dafd2f9e3
* Move python-markdown to python-coreFrancisco Redondo Marchena2015-05-051-5/+0
| | | | Change-Id: I50bc8690a84324030e806dc124c80743e510b1b9
* Use latest morphJavier Jardón2015-04-291-1/+1
| | | | | | | | | | | | This includes: e9f13c8 Fix lines bigger than 79 characters in install-essential-files.configure.help c41216a morphlib/builder.py: Add comment, os-release is now generated as an extension ed423dc Add install-essential-files configuration extension 93dd98f distbuild: Fix NameError when worker disconnects 87f8dbe Add version guessing function to gitdir and cached repo. Change-Id: Iaaf548bd6ea05b5fd10a31b4997fed6268d18904
* strata/morph-utils.morph: Use latest morphJavier Jardón2015-04-281-1/+1
| | | | | | | | | | | | | This adds: 2594f6d get-repo: Delete partially cloned repo on errors 154a760 Add armv5l to list of valid architectures fa5c470 Add a test for `morph get-repo` cc7be86 Add a `morph get-repo` command to clone repositories from the cache b0301d6 Fix regression that caused original_ref to be lost in some builds 1fd7d64 morphlib: Add example use to morph certify and fix spelling error Change-Id: I75fed399fde43a47b39f7e395aeebec656ec5333
* Update Morph to fix name of distbuild-trove-nfsboot.write.helpSam Thursfield2015-04-241-1/+1
|
* Update Morph to include:Sam Thursfield2015-04-241-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | fe15d7e Calculate the build graph in worker-build 3d87709 Make distbuild use an ArtifactReference not an Artifact internally when 5239f51 Don't serialise the entire build graph aa6dfcb Use --verbose/-v to show build output, --debug/-d for morph debug 124e2f1 distbuild: Add test suite for distbuild-helper 8103617 distbuild: Don't check if there is free disk space on the initiator 9d27007 Add distbuild-trove-nfsboot.write 006096c distbuild: Don't create a directory for build output until we get some 52ff3a3 distbuild: Kill the whole process tree when cancelling a build b2f13f7 deploy: Clean up `morph deploy` documentation a bit f163d9c deploy: Deploy and upgrade systems from the same 'cluster' definition 1c01f18 deploy: Factor out a bit of code into its own function f323af1 distbuild: Move SubprocessEventSource into its own module 40c9378 distbuild: Fix log message when listening for connections Change-Id: I97c38b65db62b0631745ac5d47d572d0218fb9ff
* Add an ostree-core stratumAdam Coldrick2015-04-231-0/+1
| | | | | | | | | | This will be used by future versions of Morph. By adding OSTree to the cross-bootstrap systems we have significantly increased the size and complexity of them. Some of this can be reduced: OStree doesn't actually depend on all of 'foundation', just 'glib'. Change-Id: I89403bf4625178e6f887402b5817f6a727cfcf97
* Split PyGObject into its own stratumAdam Coldrick2015-04-221-0/+2
| | | | | | Also make morph depend on PyGObject, it will be needed for OSTree. Change-Id: Icfa9abb95f884ca9b1dd720648567bd704e74d85
* Upgrade Morph to latest version in masterPedro Alvarez2015-04-171-1/+1
| | | | Change-Id: Ic5dfaa2eafeb3045538500c1a607c4ecab924a11
* Update Morph for ref jjardon/simple-network-networkd2Sam Thursfield2015-03-171-1/+1
| | | | Change-Id: I90345c467c397081d15be4f5e4f3d3c22b8bfbbf
* Move 'bottle' and 'flup' into separate python-wsgi moduleSam Thursfield2015-03-131-10/+1
| | | | | | | | The lorry-controller webapp uses these, as well as morph-cache-server. In order to use lorry-controller in systems that don't contain Morph, we need them to be in a separate stratum. Change-Id: Ie187c0b506d12ed5e5f8f8ce4a4b91834bf29fe5
* Move cliapp into its own 'python-cliapp' stratumSam Thursfield2015-03-121-21/+1
| | | | | | | This allows us to have a system with Lorry and Lorry Controller but without Morph. Change-Id: I5164237601d0ff028834c674274f13b6e1f315c9
* Update Morph for branch sam/distbuild-build-logsSam Thursfield2015-03-111-1/+1
|
* Fix upgrade version of MorphPedro Alvarez2015-03-071-1/+1
| | | | | | | | | | We wanted to upgrade Morph to use latest master, and because of an human error of a Friday evening we used the sha1 of master of definitions.git instead of master of morph.git in the commit c3586f5c01937e19ed1b4a4ea7f195b5045e9201. Given that I gave a +2 for upgrading Morph to latest master, I'm merging this change without sending it for review.
* Do not use 'build-depends' chunk parameter when it's empthy (and change to ↵baserock/jjardon/no_build_depends_fixJavier Jardón2015-03-061-8/+0
| | | | version: 1)
* Update morph to support version 1 definitions formatbaserock/pedroalvarez/v1updateJavier Jardón2015-03-061-1/+1
|
* Revert "Do not use 'build-depends' chunk parameter when it's empthy (and ↵Javier Jardón2015-03-061-0/+8
| | | | | | | | change to version: 1)" Morph should have been updated first This reverts commit ced4ed5f7aa35b46d161c5efea972699826f09de.
* Do not use 'build-depends' chunk parameter when it's empthy (and change to ↵baserock/jjardon/no_build_dependsJavier Jardón2015-03-061-8/+0
| | | | version: 1)
* Use latest morphbaserock/pedroalvarez/upgrade-morph-versionPedro Alvarez2015-03-061-1/+1
|
* Update Morph for branch sam/fewer-submodule-updatesSam Thursfield2015-03-031-1/+1
|
* Update Morph for ref sam/disable-new-btrfs-featuresSam Thursfield2015-02-271-1/+1
|
* Update Morph for distbuild fixes and sourceresolver bug fixesSam Thursfield2015-02-251-1/+1
|
* strata/morph-utils.morph: Add pylru dependency and update morphAdam Coldrick2015-02-181-1/+7
|
* Update Morph for ref sam/distbuild-errorsSam Thursfield2015-02-131-1/+1
|
* Move six to python-coreFrancisco Redondo Marchena2015-02-121-7/+1
| | | | | six is a python 2 and 3 compatibility library, so move to python-core should remove dependencies in some strata.
* Update morph refTiago Gomes2015-02-121-1/+1
|
* Add python-core to build-systems and as a dep of MorphSam Thursfield2015-02-101-0/+1
| | | | This allows us to use the Python 'requests' library in Morph.
* Update morph to fix virtualbox-ssh.write extensionPedro Alvarez2015-01-271-1/+1
|
* Update Morph for ARMv8 64-bit supportSam Thursfield2015-01-211-1/+1
|
* Update morph for branch sam/fix-command-loggingSam Thursfield2015-01-021-1/+1
|
* Update Morph ref to latestSam Thursfield2014-12-191-1/+1
|
* Update Morph ref for error message and documentation fixesSam Thursfield2014-12-181-1/+1
|
* Update Morph for branch pf-document-extensionsSam Thursfield2014-12-091-1/+1
|
* Update Morph for branch sam/fix-help-extensionsSam Thursfield2014-12-081-1/+1
|
* Update Morph ref for branch 'sam/build-branch-fixes'Sam Thursfield2014-12-041-1/+1
|
* Upgrade morph to fix compilation errors and testsPedro Alvarez2014-12-021-1/+1
|
* Upgrade morph to support deployments to storage devicesPedro Alvarez2014-12-011-1/+1
|
* Update morph to fix read-only subdirectories in system-integrationsRichard Maw2014-11-141-1/+1
|
* Update morph for branches sam/fix-deploy and sam/source-resolver-cleanupSam Thursfield2014-11-111-1/+1
|
* Update Morph for a couple of fixes to the GitDirectory classSam Thursfield2014-11-061-1/+1
|
View Lorry Controller Status