summaryrefslogtreecommitdiff
path: root/morphlib/app.py
Commit message (Collapse)AuthorAgeFilesLines
* Make BuildCommand report current and total build stepsLars Wirzenius2013-02-211-1/+7
| | | | | | This adds a [Build 1/12765] to the output of the building of each artifact. This makes it easier to see how much work there might still be remaining.
* Remove deprecated functionsSam Thursfield2013-02-061-24/+0
|
* Fix copyright yearSam Thursfield2013-01-291-1/+1
|
* Disable distcc by defaultSam Thursfield2013-01-291-2/+3
| | | | | | | | | | | | | | | Current versions of build-essential in the Baserock morphologies don't contain distcc, but Morph tries to use distcc anyway. Since useful operation of distcc requires setting up a distcc network, there's no reason for it to be on by default. This change fixes bootstrap, and means that users of the build-essential staging filler no longer have to set no-distcc=true manually. In the future, cliapp will grow automatic boolean negation, which will allow us to turn this setting into a 'distcc' setting that defaults to false rather than the current rather ugly double negative.
* Fix default setting for compiler cache dir; update testsJannis Pohlmann2012-12-171-4/+7
| | | | Reviewed-by: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
* Add support for ccacheJonathan Maw2012-12-171-14/+5
| | | | | | | | | | | | | | | | | | | This is set up so that each individual project repository has its own ccache, all under one defined directory. The top-level ccache directory is added as the setting 'compiler-cache-dir', and defaults to $cachedir/ccache. When a build is performed, this will bind-mount a project's ccache into the /tmp/ccache of the staging-area and set up the environment variables so that ccache will be used (if appropriate executables are installed to /usr/lib/ccache in the staging-area). In addition, this removes code for ccache-remotedir, as it is unrelated to this implementation of ccache. Reviewed-by: Jannis Pohlmann <jannis.pohlmann@codethink.co.uk> Reviewed-by: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
* Cache resolved refs and morphologies when traversing morphsJannis Pohlmann2012-12-131-4/+18
| | | | | | | This cuts down on the number of HTTP requests made while computing th build order (> create source pool > traverse morphs). In an example system I was building this patch reduced the requests from 501 to 195, reducing the time to building the first chunk from 123s to 18s.
* morph build: Allow forcing build branches to be pushedSam Thursfield2012-11-121-0/+4
| | | | | This is for users who prefer the old behaviour of building from the remote repos.
* Set option group for some advanced settingsSam Thursfield2012-10-311-20/+36
| | | | | | | | It would be nice to put every option in a group, but for now the built-in cliapp options cannot be grouped so the output is less than ideal. Also, we have no way of setting an order for groups, which results in e.g. 'Advanced Options' preceeding 'General Options' etc.
* Reduce some option descriptionsSam Thursfield2012-10-261-27/+13
|
* Reorder settings by broad categorySam Thursfield2012-10-261-58/+59
| | | | | | | | Also remove the '--ignore-submodules' option, which is redundant. Hopefully cliapp will one day support option grouping, so we can hide some sets by default and group eg. all the logging options together.
* Change the time sanity checkLars Wirzenius2012-10-081-13/+6
| | | | | | | | | | | | | We were having trouble with NTP setting the system time to be correct after .pyc files had already been created. The .pyc files got created at startup, before NTP had had a chance to run. This sometimes resulted in .pyc timestamps being wildly wrong and far in the future or past, and that would prevent morph from ever working again on the machine. We now just check that the system time is not far in the past. This is enough to make sure we don't create timestamps that break tar. Reviewed-By: Daniel Silverstone (on irc)
* No need for iterable when initializing the setJames Thomas2012-10-011-1/+1
|
* Only update repos onceJames Thomas2012-10-011-1/+5
|
* Increase verbosity regarding the remote artifact cache.Daniel Silverstone2012-09-281-1/+8
| | | | | | | This simply increases the verbosity of the operations which are done against the remote artifact cache. It should result in some progress messages if you build with --verbose set and you're mostly getting stuff from your remote artifact cache (Trove).
* Use tarballs instead of bundlesDaniel Silverstone2012-09-251-5/+5
| | | | | | | This makes a non-backward-compatible change to morph which switches it to using tarballs instead of bundles when initialising cached git repositories. This is faster because it doesn't require index-pack --fix-thin operations on the machine running morph.
* Default bundle-server and cache-server based on trove-host.Daniel Silverstone2012-09-251-3/+13
| | | | | | | This causes bundle-server and cache-server to be defaulted to appropriate Trove related URLs unless overridden in the configs. Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
* Merge branch 'baserock/radiofree/check_mtime'Lars Wirzenius2012-09-241-0/+15
|\
| * Small coding standards/message fixesJames Thomas2012-09-211-2/+2
| |
| * Check the mtime of the app.py to make sure it is not in the futureJames Thomas2012-09-211-0/+15
| | | | | | | | If it's in the future this may cause problems, so exit with an error
* | morph petrify: Rewrite in the style of todaySam Thursfield2012-09-211-3/+2
|/
* Merge branch 'samthursfield/S4556-triplet-consistency' of ↵Richard Maw2012-09-131-1/+1
|\ | | | | | | git://roadtrain.codethink.co.uk/baserock/morph
| * Don't require .morph in triplet argumentsSam Thursfield2012-09-121-1/+1
| | | | | | | | | | | | | | | | | | This gives us consistency with morphologies, where the triplets are repo|ref|morphology, not repo|ref|filename Anyone who runs 'morph build baserock:morphs master system.morph' will now see an error ending with 'was looking for system.morph.morph', which should make it clear where they have gone wrong.
* | Test the trove-* support.Daniel Silverstone2012-09-121-0/+4
| | | | | | | | | | | | | | | | | | This adds a way to cause the processed configuration to be dumped out. We do this in the overridden process_args method so that the configuration dumped has had all the processing done on it which is necessary. The test then uses this functionality to ensure that the repo-alias setting has been correctly updated with the Trove-hosted prefixes.
* | Add support for Trove hosted content to morph configuration.Daniel Silverstone2012-09-121-6/+26
|/ | | | | | | | | | | Trove has a fixed structure for repositories and prefixes. By taking advantage of this, we can simplify the repo-alias configuration in morph somewhat and thus make it easier for others to add their own aliases and prefixes later, without worrying that they'll miss out on default ones created by the Baserock team. We override process_args in the application class to achieve this because cliapp's setup() hook is not quite right for our purposes.
* Add 'build-prefix-ref' setting for creating temporary build refsJannis Pohlmann2012-09-071-0/+6
| | | | | | | This is needed to create temporary build refs and push them to the repository server. We want this to be configurable to make things more flexible with regards to different repository server configurations.
* Resolve tree SHA1 along with commit SHA1 when resolving refsJannis Pohlmann2012-09-051-9/+9
| | | | Adjust all other parts and the tests to work with this.
* Strata should be referred to with full repo/ref/morph tripletsSam Thursfield2012-08-301-2/+2
| | | | | | | | This removes the requirement that all strata must be in the same repo as the system morphology. Both the system "strata" field and the stratum "build-depends" field are affected.
* Strata contain "chunks", not "sources"Sam Thursfield2012-08-291-1/+1
| | | | Rename "sources" field of stratum morphologies to "chunks".
* Change default repo-aliases to git.baserock.orgDaniel Silverstone2012-08-151-5/+5
| | | | | | | Sanitise the git repo aliases to use git.baserock.org instead of the old roadtrain.codethink.co.uk hostname. This will cause a re-fetch of gits, unless you fix up your cache first
* Move cmd_build to a separate pluginRichard Maw2012-08-011-17/+0
| | | | | It's such a small amount of code, it's possibly not worth it, but now all commands are in plugins.
* Move BuildCommand from app into its own moduleRichard Maw2012-08-011-279/+1
| | | | | | | | morphlib.app should be for application bringup and providing command line options used by the library code. Any external plugins that refer to morphlib.app.BuildCommand will need fixing.
* Move edit to plugin and remove dead code from appRichard Maw2012-08-011-156/+0
| | | | | Some miscellaneous cleanup of functions was done, so new apis like savefile and status are used.
* Move merge command to pluginRichard Maw2012-08-011-18/+0
| | | | | | | resolve_reponame is now duplicated since other functions use it. cmd_edit uses everything, so they can be removed from morphlib.app when it is moved to a plugin.
* Move command petrify to branch_and_merge pluginRichard Maw2012-08-011-35/+0
| | | | | This does not require any other function movements, due to its simple implementation.
* move command show-system-branch to pluginRichard Maw2012-08-011-12/+0
| | | | | deduce_system_branch is now duplicated because other commands not yet moved require it.
* Move commands branch and checkout to pluginRichard Maw2012-08-011-41/+0
| | | | | clone_to_directory is currently duplicated because other commands not yet moved require it.
* Move init and minedir to branch_and_merge pluginRichard Maw2012-08-011-28/+0
| | | | | deduce_mine_directory is duplicated in the plugin and morphlib.app until all the commands are moved into the plugin.
* Move command make-patch to Trebuchet pluginRichard Maw2012-08-011-91/+0
| | | | | | | | The plugin is called trebuchet, so that if any other functionality is required from morph it has a place to go. make-patch generates a trebuchet patch, so it should go in the trebuchet plugin.
* Move utility functions for creating cachesRichard Maw2012-08-011-43/+4
| | | | | | | | | | | Code for creating caches is repeated through the codebase because there wasn't a useful function for creating caches. Now the functions in BuildCommand have been moved into morphlib.util, where they will be more usefully reachable. Stubs have been left in BuildCommand so they can be overridden by subclasses of BuildCommand and not break external plugins.
* morph: move update-gits to pluginRichard Maw2012-08-011-48/+18
| | | | This also publicizes cache_repo_and_submodules and traverse_morphs
* Publicize _itertriplets and _create_source_poolRichard Maw2012-08-011-6/+19
| | | | | | | | | itertriplets and create_source_pool are more convenient than doing it manually, and since they need to be used by plugins, they shouldn't be private. The private name is kept as an alias so that external plugins that were poking at the internals for convenience aren't broken.
* move show-dependencies command into a pluginRichard Maw2012-08-011-39/+0
|
* python scripts: pep8ize codebaseRichard Maw2012-08-011-168/+170
| | | | | | | | | This was done with the aid of the pep8 script, available by running `easy_install pep8`. It may be worth making this part of ./check, but that will require putting pep8 into the development tools stratum. This should be easy, given pep8 has no external dependencies.
* Fix code path for error handlingLars Wirzenius2012-07-261-4/+7
| | | | The old stuff was trying to use an uninitialized local variable.
* Refactor system building to use syskind specific classLars Wirzenius2012-07-261-0/+2
|
* Merge branch 'liw/require-system-kind'Lars Wirzenius2012-07-231-4/+2
|\ | | | | | | | | Reviewed-By: Richard Maw Reviewed-By: Lars Wirzenius
| * Set Morphology.needs_artifact_metadata_cachedLars Wirzenius2012-07-191-3/+1
| |
| * Have MorphologyFactor set Morphology.needs_staging_areaLars Wirzenius2012-07-191-1/+1
| |
* | morph: Add a sensible default path of morphlib/pluginsRichard Maw2012-07-181-0/+4
|/ | | | | | | | | | Plugins which don't need configuring should install themselves into morphlib/plugins, this can be done as part of distutils by import morphlib plugin_dir = os.path.join(os.path.dirname(morphlib.__file__), 'plugins') from distutils.core import setup setup(data_files=[(plugin_dir, plugins)])
View Lorry Controller Status