summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * MorphologyLoader: Validate new fieldsRichard Maw2014-01-162-6/+204
| |
| * Replace chunk 'chunks' field with 'products'Richard Maw2014-01-157-19/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | I think that it's confusing for both strata and chunk morphologies to have a 'chunks' field, with the former listing sources and the latter listing rules for splitting this source into artifacts. The design for splitting strata has roughly the same idea, but operating on chunk artifact names, rather than file names, so a name that can be used for both was chosen. Splits and artifacts weren't satisfactory names, so they're now called 'products'. It was decided to break backwards compatibility of chunk morphologies being able to specify 'chunks', since the format has changed, so extra code would be required to translate the format, and the only users of the 'chunks' field was the test suite, since there was no way to select from the system, which chunk artifacts were included.
| * ArtifactResolver: Use Artifacts from SourcesRichard Maw2014-01-151-20/+9
| |
| * Source: Create all Artifact objects in advanceRichard Maw2014-01-151-1/+4
| | | | | | | | | | | | | | | | This simplifies logic for the ArtifactResolver, since it doesn't need to have its own cache of (source, artifact_name) -> artifact and the artifacts a source produces can be iterated directly with the artifacts attribute, rather than having to iterate over the names and look up the artifact object.
| * morph2.Morphology: add trivial .get methodRichard Maw2014-01-151-1/+9
| | | | | | | | | | This it convenient, as it allows the new validation code to validate the old morphology class during the transition period.
| * BuildCommand: Validate multiple root morphologiesRichard Maw2014-01-151-11/+21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | When you attempt to build a stratum or chunk, the ArtifactResolver can return multiple root artifacts, since the root source produces multiple artifacts. Rather than having the BuildCommand complain that there's multiple root artifacts, it now validates all the produced artifacts too, since that will validate the kinds of artifacts produced, and give a more useful error message, that you're trying to build a stratum or chunk directly. If all the produced artifacts validate, then an exception is raised to signal that it got multiple artifacts, when it only expected one.
| * unit tests: Fix invalid morphologiesRichard Maw2014-01-154-13/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Later validation work causes the morphologies to be validated, when they weren't previously. This would cause the test suite to not pass, since the morphologies defined in the tests are malformed. One common problem was tests that, instead of a name field, had the name of the morpholgy in a field called "chunk". There were a few cases of new fields being needed, since the tests were written before they became mandatory. The most interesting failure was a Source being created, which instead of being passed a morphology object, was passed a string.
| * yarns: Add a deploy testRichard Maw2014-01-152-3/+49
| |
| * yarns: Make test chunk create representative filesRichard Maw2014-01-151-2/+134
| | | | | | | | | | | | | | It's useful for the splitting tests that will be implemented later, for there to be files that are representative of the files that would be on a common root filesystem, so the match rules can be tested by the right chunk artifacts containing the right files.
| * yarns: Remove redundant repo in IMPLEMENTS THENRichard Maw2014-01-093-4/+4
| | | | | | | | | | morph build the system... doesn't need the repository to be specified, just the branch; morph is able to work it out for itself.
* | Merge branch 'richardipsum/install_files_mod'Richard Ipsum2014-01-161-11/+31
|\ \ | |/ |/| | | | | | | Reviewed-by: Richard Maw Sam Thursfield
| * Add optional overwrite optionrichardipsum/install_files_modRichard Ipsum2014-01-161-11/+31
| | | | | | | | | | | | | | | | | | | | | | This option lets the install-files config extension overwrite existing files. A file will only be overwritten if the overwrite flag is specified for that file. Since the overwrite arg is optionally prepended to the manifest line, this patch should not break existing manifests With this patch default config files can be replaced with project specific config files
* | Merge branch 'liw/update-NEWS-for-BR13'baserock-13Lars Wirzenius2014-01-061-1/+43
|\ \ | |/ |/| | | | | Reviewed-by: Dan Firth Reviewed-by: Richard Maw
| * Update NEWS based on feedbackLars Wirzenius2014-01-061-4/+5
| | | | | | | | Feedback by Richard Maw.
| * Update NEWS for Baserock 13 releaseLars Wirzenius2014-01-061-1/+42
|/
* Merge branch 'benbrown/RT44'Ben Brown2013-12-2013-551/+149
|\
| * LocalArtifactCache now takes a an FS objectDaniel Firth2013-12-204-53/+40
| |
| * Removed unused CacheDir classDaniel Firth2013-12-203-215/+0
| |
| * Replaces Tempdir with fs.tempfs.TempFSDaniel Firth2013-12-205-152/+50
| |
| * Refactored localrepocacheDaniel Firth2013-12-202-131/+59
|/
* Merge branch 'baserock/pedroalvarez/fix-cross-bootstrap6'Pedro Alvarez2013-12-205-4/+88
|\ | | | | | | Reviewed-by: Richard Maw
| * Add yarn test for cross-bootstrapPedro Alvarez2013-12-202-3/+69
| |
| * Fix old cross-bootstrap testPedro Alvarez2013-12-201-1/+2
| |
| * Deploy and cross-bootstrap commands no longer validate host architectureBen Brown2013-12-202-0/+17
|/
* Merge branch 'benbrown/quote-filename-and-ref'Ben Brown2013-12-182-10/+15
|\
| * Quote ref and filenameBen Brown2013-12-182-10/+15
|/ | | | | | Previous fix only quoted URLs, which fixed petrify --no-git-update, but not the whole problem, quoting ref and filename prevents other problems that may be caused by non URL friendly characters.
* Merge branch 'benbrown/S9850/strip-morph-extension'Ben Brown2013-12-165-5/+38
|\
| * Modify morph to strip .morph extensions from parametersBen Brown2013-12-165-5/+38
|/
* Merge branch 'benbrown/S9823/petrify-no-update'Ben Brown2013-12-112-7/+9
|\
| * urllib: Convert URLs with non URL friendly characters into a valid format.Ben Brown2013-12-112-7/+9
|/
* Merge remote-tracking branch ↵Lars Wirzenius2013-11-2919-205/+972
|\ | | | | | | 'remotes/origin/baserock/richardmaw/S9475/refactor-build-cmd-v3'
| * plugins: Convert deploy to new classes.Richard Maw2013-11-291-85/+70
| | | | | | | | | | | | | | | | | | It now does not push branches as this is not necessary to locate the artifact. It still makes temporary build branches, since it is assumed that if you have changes in your workspace, it's preferable for the deploy to fail, rather than think you've deployed something you haven't.
| * yarns: Change expected result of building uncommitted morphologiesRichard Maw2013-11-291-3/+1
| | | | | | | | | | The new build code uses `git update-index --add`, which means it can use morphologies that haven't previously been added.
| * plugins: Use new build command as defaultRichard Maw2013-11-292-2/+2
| | | | | | | | The old build is still around for comparison.
| * plugins: Add new build commandRichard Maw2013-11-291-0/+92
| | | | | | | | | | | | This uses all the new APIs, so the code is shared across morphlib and unit tested rather than everything being in one massive plugin that is only black-box tested.
| * morphlib: Add BuildBranch abstractionRichard Maw2013-11-293-0/+263
| | | | | | | | | | | | | | This is an abstraction on top of SystemBranchDirectories, providing the ability to add uncommitted changes to the temporary build branch, push temporary build branches and retrieve the correct repository URI and ref to build the system.
| * branchmanager: Allow deferred and optional cleanup on success.Richard Maw2013-11-292-14/+179
| | | | | | | | | | | | | | | | | | | | | | | | Now it will optionally clean up on success based on a constructor parameter. It can be later cleaned up explicitly by calling close(). It is called close, rather than something more obvious, like cleanup(), since it means the manager can be re-used with contextlib.closing(). This now means that using the Managers without a context manager is less ugly, since you can explicitly call .close() in a finally block.
| * sysbranchdir: Move load_all_morphologies helper hereRichard Maw2013-11-293-10/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This was previously a private method of the branch and merge plugin, but it's useful to other plugins, so has been moved to the SystemBranchDirectory class, where everything else can get to it. It has an unpleasant amount of coupling to other classes, but in a *good* object oriented design it would either be a tiny module on its own, or not exist and leave all its users to re-implement the same logic multiple ways, so we've opted for a less clean, but more useful design. It is left un-covered by the unit tests, since it requires a great deal of instrumentation to test, at which point it may be best to leave it to integration tests.
| * yarns: un-parameterise architecture in system morphologiesRichard Maw2013-11-293-10/+18
| | | | | | | | | | | | It doesn't make sense to be able to specify an architecture from the IMPLEMENTS name, since you either need your architecture for something to build, or testarch for something that consistently doesn't build.
| * morphloader: use getattr for validate, set defaultsRichard Maw2013-11-291-16/+5
| | | | | | | | It saves some boilerplate.
| * validation: Require there be non-bootstrap chunks in systemsRichard Maw2013-11-293-8/+86
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Bootstrap chunks don't make it into the final system, so there needs to be an extra check for empty systems after the sources have been collected. This was complicated slightly by the fact that if you try to build a chunk directly you will have no strata in your sources, hence no non-bootstrap chunks, but validation for having been told to build a chunk is best handled later. This amends the old yarns that depended on building a bootstrap chunk and adds a new one that explicitly builds a system with bootstrap chunks.
| * morphloader: Require systems have at least one stratumRichard Maw2013-11-294-48/+155
| | | | | | | | | | | | | | | | | | | | It doesn't currently make sense to build a system which contains no strata. We may later add other fields, such as initramfs to contribute to the system's artifact, but until then it's another bug to trip over. This uses collections.Sequence for checking the type of the systems entry in the morphology as a style choice, though it allows more flexibility if the types in the parsed morphology change.
| * morphloader: Set default values for cluster morphsRichard Maw2013-11-292-3/+54
| | | | | | | | | | | | | | | | This was omittted from the MorphologyLoader due to cluster morphologies being added at about the same time. This bug escaped detection since the MorphologyLoader was not required to deploy. It soon will be.
| * morphloader: Don't use ValueError exceptionRichard Maw2013-11-292-4/+26
| | | | | | | | | | Dedicated exceptions allow more fine-grained exception catching and can have extra data.
| * yarns: Correctly allow run_morph to output stderr on failureRichard Maw2013-11-291-7/+10
|/ | | | | Set -e meant that the stderr could never be re-output, catching the return code and re-outputting was not sufficient.
* Merge branch 'master' of git://git.baserock.org/baserock/baserock/morphLars Wirzenius2013-11-282-1/+2
|\
| * Merge branch 'baserock/pedroalvarez/ppc64-port'Pedro Alvarez2013-11-282-1/+2
| |\ | | | | | | | | | Reviewed-by: Lars Wirzenius
| | * Make morph able to use ppc64 architecture (POWER PC 64 bits)Pedro Alvarez2013-11-272-1/+2
| |/
* | Merge remote-tracking branch ↵Lars Wirzenius2013-11-281-0/+3
|\ \ | |/ |/| | | 'remotes/origin/baserock/ps/show-stratum-versions-in-build'
| * show which ref is expected for each stratum when preparing buildPaul Sherwood2013-11-211-0/+3
| |