| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
|
|
| |
Update morph to the latest master ref.
Change-Id: Id4aaf9576f542c5d1dbadee4cdca004d907014bd
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This removes support for definitions V6, and adds support for
definitions V8.
The last release of the Baserock reference system images was 15.47.1,
which used definitions V6.
Full list of changes:
a7f1247 Add support for definitions version 8
9404317 Remove support for definitions version 6
575c40c Adapt integration test to definitions version 7
0ee859a morphloader: simplify API
d58d8e8 Unify local and remote repo cache modules
014a029 Get rid of the CachedRepo class (almost)
e8a67a7 Hide get_repo() and cache_repo() functions, always use
get_updated_repo()
bb139ec Fix some test failures
Change-Id: Ied8aa209ab8eede2a160c4273f93c15b7ff41793
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
New version includes some fixes for UnicodeDecodeError's using
distbuild. It also includes some Warnings and Errors when there is a
component name mismatch.
Full list of changes:
7067e40 Fix copyright year of morphlib/morphloader.py
472dbbb Error when different names in system/strata
c1aa6a4 Warning when different names in strata/chunks
fb6dd95 Validate empty configure/build/test/install commands
7e15ed7 Avoid stack overflow in cachekeycomputer
bda9fe5 Avoid UnicodeDecodeError when writing to log files
c03b9c7 deploy: Fix an unlikely crash at deploy-time
Change-Id: I1b61af0a53e4f0af9fbed39fda7e12b12f0e009c
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This includes some important fixes for how Morph builds definitions
version 7. Previously it didn't correctly implement version 7 of the
definitions format.
Some artifact filenames will change with the new version of Morph, due
to the fixing of a bug that meant they contained the filename instead of
the chunk name in some cases. This will cause rebuilds.
Full list of changes:
535443b sourceresolver: Use real name for sources without chunk file
efd53e3 Fix unused 'bs' var in builder
4196338 check-copyright-year: Check author date instead of commiter date
d5c616d Fix breakage when new build systems are added to DEFAULTS
8698688 More robust creation of tempdirs
b3ecd02 distbuild: Avoid UnicodeEncodeError when writing build output to
log files
fa431c3 More robust creation of cache dirs
0f00fbb Don't show progress bars if stderr is being redirected to a file
a7431e3 morphloader: remove alias
7d58040 morphloader: remove unset functions
6633cfd morphloader: remove arch normalization
740609f morphloader: remove obsolete fields
52bfd9c Remove non-existing files from without-test-modules
ca1ddcb Cleanup buildbranch.py module
ae13dbb Remove (dist)?build-morphology commands
0d24e38 Convert last cmdtests to yarns
c8f97d3 Remove tests specific build-morphology command
c581080 Fix displaying the help for extensions
df7437d Rename yarn file to a more appropriate name
3088878 Fix path used in a scenario
38f3560 Tests: rename git repository
d71d482 Rename an IMPLEMENTS that mentions system branch
fcb02bf Remove unused functions from morph.shell-lib
2c2be06 Remove unused IMPLEMENTS
c0659fa Remove SystemBranchDirectory and Workspace classes
13fa0d1 Prepare the removal of workspace and system branches code
25617bd Cease modifying the morphologies
10a2f10 Remove SystemMetadataDir class
66860eb Remove branch-and-merge plugin
cbc3d78 Remove tests for branch-and-merge plugin
822d541 Update README file
c923734 yarns: remove unused morph status implementations
36b312b yarns: drop use of workspace
91c2f6a yarns: Remove unused edit implementations
b549c36 Remove old cruft
Change-Id: Id1e72430fe07fd4005195af5a89d8fa2d677c42d
|
|
|
|
| |
Change-Id: I9ab7820b9a6fd6c018db4a3b1a9fa4911710b46c
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
From [1]:
"Python 2.x is legacy, Python 3.x is the present and future of the language"
As a reference, python3 is already the default python version in Arch,
and other distros like Ubuntu/Debian [2] or Fedora [3] are planning to
switch soon
[1] https://wiki.python.org/moin/Python2orPython3
[2] https://wiki.ubuntu.com/Python/3
[3] https://fedoraproject.org/wiki/Changes/Python_3_as_Default
Change-Id: I6d4d11844d4424bfa49b37fe7d9a3639547c0139
|
|
|
|
| |
Change-Id: I08891e20fc8172ff2a4e9171c87f21f10dc019cf
|
|
|
|
| |
Change-Id: I3845c77e8872ce2e1e8bc6a60e3ce7f184c32f58
|
|
|
|
|
|
|
| |
This version fixes an assertion failure when running the definitions
migrations scripts.
Change-Id: If96a5d6bf8376b684d418e621b5d419541fdbe31
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This includes the following changes:
Add support for Baserock definitions version 6
Remove support for Baserock definitions format versions 0, 1 and 2
Don't provide default strip-commands for 'manual' build system
Extract downloaded tarball as current user
Add bitbucket repo alias to default aliases
sourceresolver_tests: Remove bogus test
sourceresolver_tests: Fix invalid backup definition
distbuild: Fix cache status message
distbuild: Fix crash when worker disconnects
distbuild: Fix partial distbuilding
distbuild: Add __str__() and __repr__() to ArtifactReference
distbuild: Hide a log message
distbuild: Check cache status each time we enqueue new artifacts
distbuild: Add docstrings to BuildController state machine
Fix crash in `morph distbuild` command
Make `morph show-build-log` look in local repo cache for build logs
Make more commands work outside a system-branch/workspace
Determine whether to include_local_changes from app.settings
Raise exception if show-build-log doesn't find the build log
Fix `morph show-build-log` for chunks of a different architecture
localrepocache: Count freshly cloned repositories as updated
Fix anchor yarn
Add script to run a distbuild network on the local machine
Don't ignore the 'cwd' parameter
Expose reset_workdir in GitDirectory class
Swap repr() for str() in ref add errmsg
Improve error when local HEAD of definitions repo is not found in remote
Use DefinitionsRepo class in deploy plugin
Use DefinitionsRepo in build command
Add DefinitionsRepo class
Treat True and False as actual commands, rather than booleans.
buildsystem: Comment strip command
Change-Id: Ic55e12bfe5e98f4a1a4df875c23ad3d447f7038c
|
|
|
|
|
|
|
|
|
|
|
|
| |
This is currently done by adding it to the 'morph-utils' stratum,
because it is used as a tool for working with .morph files.
The ruamel.yaml library allows writing YAML files while preserving
comments, ordering and some formatting form the input files. This makes
it more practical for us to write automated migration scripts for
Baserock definitions.
Change-Id: I886232dad4d64bcf1803f52e94ae25b0fa2d9969
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This gets the following changes:
2579391 buildsystem: Comment strip command
7f2ccd3 sourceresolver: Support version 5
c80c676 Set PYTHONPATH when running deployment extensions
d95bd9e cachekey/builder: Use and cache strip commands
acdc5ce sourceresolver: Use versioned morphology loader
afee581 morphloader: Smoke test strip command inclusion
600f264 morphloader: Allow build-system lookup to be customised
de977c0 morphloader: When given definitions v5, include strip commands
15da1e3 buildsystems: Add strip commands
0feb10b sourceresolver: Re-order method definitions in use order
4ceaa8c sourceresolver: Pass all hidden state
117413f Fix test suite
d8e7abe CacheKeyComputer: Only attempt to include commands present in morphology
0ed681e morphloader: Hoist buildsystem lookup outside of loops
22232a8 morphloader: Add test-commands to key order
7f3b39d sourceresolver: bind util.sanitise_morphology_path
8101068 sourceresolver: Remove cache_repo_locally
4ed27e0 sourceresolver: Use context managers for cleanup and cache writeback
d873baa morphlib: Use new temp_dir helper context manager
061834b morphlib.util: Add temp_dir context manager
eb3eb47 sourceresolver: Pass build system directly to morphology creation
e7027e5 Add separate_mount_namespace kwarg to ext runner
56c7db5 Do not call str() on None types in sanitize_env
7929082 Ignore the configuration extensions when generating the cache-key
501181a Use keystoneclient python api in openstack.check
9a831cc deploy: Don't imply --upgrade in subsystems
87bfac4 morph deploy: Allow overriding UPGRADE in definition or on command line
4ce4366 Ignore --upgrade flag rather than exiting
05b2b06 Move 'git config' wrapper into its own class
5387806 check: Allow yarns to be run with --snapshot
4e07f7e yarns: Fix typo in cross-bootstrap yarn
31ddf5d yarns: Add a test for `morph list-artifacts`
8eef287 yarns: Add a test for `morph certify`
4dcc23b yarns: Add a test for `morph generate-manifest-csv`
6fd766d generate-manifest-csv: Catch NoRemote error when cloning lorries repo
f72b4dc Give exact filename when an artifact is not found in the cache.
5dd1f23 Use protocol to validate incoming requests
ddef6ab Disable WC exec-output messages in log by default
88967bf Disable logging of build output by default
c373f5a Bump supported definitions version to version 4
4131947 distbuild: Handle errors from socket
8625124 distbuild: Condense Initiator class to remove unnecessary duplication
2c2b113 Add .gitreview file
2607fa3 Fix crash in handling of recursive submodules
Change-Id: Ib7e2db60a9ec4f6196e6a4b4ecd53ed9b0b0c3cc
|
|
|
|
|
|
|
|
|
| |
For these changes:
1da8ee6 Fix prototype of create_source_pool()
d7e8604 Protocol check fix
Change-Id: I80b14ca81a04c64a60f4332059927ffdc097d22e
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This includes the following changes:
eda5cb2 Explain how to cancel a distbuild
eb9e43d distbuild: Set job status to failed when sending exec-cancel
43fed1e Revert "distbuild: Track worker jobs using artifact basename only"
aa19fb9 Remove mention of MorphologyFactory in the unit tests
9cc12c9 Clean up artifact serialisation
2d19611 Move duplicate fix_chunk_build_mode function to a common location
1c45305 Enable native-bootstrap to continue build after recovered from fault.
fdd6aeb Remove % from debug statement
733d6f9 Add a common func for handling build termination
f4360e3 Add GraphProgress messages
cc79a6b distbuild: Fix protocol version checking for distbuild commands
5aa34de yarns: Add yarn for morph diff
2d2774a yarns: Add the ability to tag chunks and commit updates to definitions
e2e2ede morph: Add morph diff subcommand
812492d morphlib: Add utility module for parsing argv into lists of systems
d22a4a2 distbuild: Builds currently break due to job being set twice
4cc7503 SourceResolver: Allow the resolution of multiple systems
43ae0cc LRC: Make get_updated_repo handle multiple refs
5f48a25 MorphologyLoader: Set filename attribute at parse time
af5866c morph anchor: Handle updating refs
6aec7d7 morphlib.util: add word_join_list
7fe5c48 yarns: Fix incorrect chunk name in test suite
Change-Id: Iaffcdd506dac6a31f1a11d9218afcb7f31b26758
|
|
|
|
|
|
|
| |
Changes:
524b17f Fix mistake in sysroot.write
f9a0607 Raise an error if a stratum build-depends on itself
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Full list:
0b2b24a distbuild: Fix initiator hanging when protocol errors occur
f6e3627 Fix sysroot.write trying to overwrite existing files
e08f3e3 distbuild: Allow WorkerConnection to track multiple in-flight jobs
75ef3e9 distbuild: Track worker jobs using artifact basename only
be3383e distbuild: Track state of a job in the Job class
44917b2 distbuild: Make Jobs class into a more generic JobQueue
42b915c Make str() of a GitDirectory return its location.
6db8c4f Make listing contents of local tarball cache more robust
07a0b83 Show progress of downloads when --verbose is passed, not --debug
11391bc GitDir: Fix setting fetch url when push url is already on-disk
534fe7a Update distbuild protocol version to 3
a030d42 Add yarns for basic `morph anchor` functionality
8956e5e Add `morph anchor` command
b477acb yarns: Fix typo in system branch creation yarn
f4ec3d2 yarns: Fix get-repo test falsely checking exit result
eaa0685 RemoteRefManager: Fail all ref updates when one fails
2904830 GitDir: Set the fetch or push url when the other is set
9e074be yarns: Have non-bogus trove config
1f66776 CachedRepo: Fix reference to _gitdir
93b034f install-files.configure: make possible to overwrite symlinks
7e5bab5 Add a test for partial deployment
1d57b19 Allow the deployment of individual chunks/strata from systems
2985a46 morphlib: Add command to get build-log for a given chunk and system file
9867774 Add ssh keys conf ext
74ac75d Fix partial distbuilds of non-existant components
f964cf0 Add a CSV manifest generator.
5ea105a Check number of args given to build commands
34870ac Improve 'Deploy failed as system is not yet build' error.
c9ebfbf GitDirectory: Add a store_commit method
ae17229 gitdir.PushFailureError: Show why pushes failed
f489767 CachedRepo: Expose the internal gitdir object
7bf8fda morph help: Expand upon the importance of the first trove-id
442e62c Install licensecheck.pl with morphlib
dd755f8 Ignore BuildProgress messages
ac6d189 Remove n_state_machines_of_type function
4941d1d distbuild: Add distbuild status command
8409655 distbuild: Add distbuild start and cancel functionality
4a1c2d1 distbuild: Add protocol version checking for list-jobs command
8875e9c Bump supported definitions format version to 3
Change-Id: Ic827f1024ad4491938b5b0bfc1f2971dafd2f9e3
|
|
|
|
| |
Change-Id: I50bc8690a84324030e806dc124c80743e510b1b9
|
|
|
|
|
|
|
|
|
|
|
|
| |
This includes:
e9f13c8 Fix lines bigger than 79 characters in install-essential-files.configure.help
c41216a morphlib/builder.py: Add comment, os-release is now generated as an extension
ed423dc Add install-essential-files configuration extension
93dd98f distbuild: Fix NameError when worker disconnects
87f8dbe Add version guessing function to gitdir and cached repo.
Change-Id: Iaaf548bd6ea05b5fd10a31b4997fed6268d18904
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This adds:
2594f6d get-repo: Delete partially cloned repo on errors
154a760 Add armv5l to list of valid architectures
fa5c470 Add a test for `morph get-repo`
cc7be86 Add a `morph get-repo` command to clone repositories from the cache
b0301d6 Fix regression that caused original_ref to be lost in some builds
1fd7d64 morphlib: Add example use to morph certify and fix spelling error
Change-Id: I75fed399fde43a47b39f7e395aeebec656ec5333
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
fe15d7e Calculate the build graph in worker-build
3d87709 Make distbuild use an ArtifactReference not an Artifact
internally when
5239f51 Don't serialise the entire build graph
aa6dfcb Use --verbose/-v to show build output, --debug/-d for morph
debug
124e2f1 distbuild: Add test suite for distbuild-helper
8103617 distbuild: Don't check if there is free disk space on the
initiator
9d27007 Add distbuild-trove-nfsboot.write
006096c distbuild: Don't create a directory for build output until we
get some
52ff3a3 distbuild: Kill the whole process tree when cancelling a build
b2f13f7 deploy: Clean up `morph deploy` documentation a bit
f163d9c deploy: Deploy and upgrade systems from the same 'cluster'
definition
1c01f18 deploy: Factor out a bit of code into its own function
f323af1 distbuild: Move SubprocessEventSource into its own module
40c9378 distbuild: Fix log message when listening for connections
Change-Id: I97c38b65db62b0631745ac5d47d572d0218fb9ff
|
|
|
|
|
|
|
|
|
|
| |
This will be used by future versions of Morph.
By adding OSTree to the cross-bootstrap systems we have significantly
increased the size and complexity of them. Some of this can be reduced:
OStree doesn't actually depend on all of 'foundation', just 'glib'.
Change-Id: I89403bf4625178e6f887402b5817f6a727cfcf97
|
|
|
|
|
|
| |
Also make morph depend on PyGObject, it will be needed for OSTree.
Change-Id: Icfa9abb95f884ca9b1dd720648567bd704e74d85
|
|
|
|
| |
Change-Id: Ic5dfaa2eafeb3045538500c1a607c4ecab924a11
|
|
|
|
| |
Change-Id: I90345c467c397081d15be4f5e4f3d3c22b8bfbbf
|
|
|
|
|
|
|
|
| |
The lorry-controller webapp uses these, as well as morph-cache-server.
In order to use lorry-controller in systems that don't contain Morph,
we need them to be in a separate stratum.
Change-Id: Ie187c0b506d12ed5e5f8f8ce4a4b91834bf29fe5
|
|
|
|
|
|
|
| |
This allows us to have a system with Lorry and Lorry Controller but
without Morph.
Change-Id: I5164237601d0ff028834c674274f13b6e1f315c9
|
| |
|
|
|
|
|
|
|
|
|
|
| |
We wanted to upgrade Morph to use latest master, and because of
an human error of a Friday evening we used the sha1 of master of
definitions.git instead of master of morph.git in the commit
c3586f5c01937e19ed1b4a4ea7f195b5045e9201.
Given that I gave a +2 for upgrading Morph to latest master, I'm
merging this change without sending it for review.
|
|
|
|
| |
version: 1)
|
| |
|
|
|
|
|
|
|
|
| |
change to version: 1)"
Morph should have been updated first
This reverts commit ced4ed5f7aa35b46d161c5efea972699826f09de.
|
|
|
|
| |
version: 1)
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
|
|
|
|
| |
six is a python 2 and 3 compatibility library, so move to python-core
should remove dependencies in some strata.
|
| |
|
|
|
|
| |
This allows us to use the Python 'requests' library in Morph.
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|