summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* fixup: Serialise less stuffbaserock/adamcoldrick/speed-up-distbuild-ipcAdam Coldrick2015-03-101-25/+28
|
* loggingAdam Coldrick2015-03-102-22/+6
|
* TEMP: Only run distbuild testAdam Coldrick2015-03-101-77/+77
|
* WIP: Changes to distbuild pluginAdam Coldrick2015-03-101-5/+20
|
* WIP: Changes to worker_build_schedulerAdam Coldrick2015-03-101-17/+20
|
* WIP: Make serialisation serialise less dataAdam Coldrick2015-03-101-153/+108
|
* WIP: Changes in build_controller.pyAdam Coldrick2015-03-102-11/+11
|
* yarns: Make the distbuild yarn expose the worker's artifact cache over HTTPAdam Coldrick2015-03-103-4/+30
| | | | | | | | | OSTree can easily pull over HTTP. All that is necessary is to expose the repo directory. This commit adds a simple HTTP server to do this in the test suite. Actual implementations should use something better, like lighttpd. Also add some logging of the cache servers in this yarn to help debug.
* Add script to run a distbuild network on the local machineSam Thursfield2015-03-101-0/+402
| | | | | | | This extends the work Richard Maw did on getting distbuild to run locally. It's now possible to interact with the local distbuild network, where before it could only be used as part of Yarn tests. It's also easy to have more than a single worker now.
* Minimise repo cache fetchesRichard Ipsum2015-03-071-21/+49
| | | | | | | If we know the build system for a chunk is cached then we also know that it doesn't have a chunk morph, so we don't need to look for one. (We only cache the build systems of chunks that don't have chunk morphs)
* Fix bug in build system cache accessRichard Ipsum2015-03-071-3/+11
| | | | | | | | | This fixes a bug that causes morph to run build system detection even though the build system has already been cached. The cache is accessed before the key has been computed (absref isn't known until after we've called resolve_ref) so it always misses.
* Merge branch 'jjardon/no_build_depends'Javier Jardón2015-03-064-55/+11
|\ | | | | | | | | | | Reviewed-By: Paul Sherwood <paul.sherwood@codethink.co.uk> Reviewed-By: Sam Thursfield <sam.thursfield@codethink.co.uk> Reviewed-By: Pedro Alvarez <pedro.alvarez@codethink.co.uk>
| * Do not fail if a chunk doesnt have a 'build-depends' parameter definedjjardon/no_build_dependsJavier Jardón2015-03-042-20/+10
| |
| * morphlib/morphloader_tests.py: Remove test to require 'build-depends'Javier Jardón2015-03-041-21/+1
| |
| * morphlib/sourceresolver_tests.py: Remove test to require 'build-depends'Javier Jardón2015-03-041-14/+0
| |
| * morphlib/sourceresolver.py: Check and parse VERSION fileJavier Jardón2015-03-041-0/+25
| | | | | | | | | | | | | | | | | | | | | | Only fail if: - VERSION file exists - and its a yaml file - and its a dict - and has the key 'version' - and the contents of the key 'version' is an int - and that int is in the list of non_supported_versions (empty at the moment)
| * morphlib/sourceresolver.py: Remove not used functionsJavier Jardón2015-03-041-16/+0
| | | | | | | | _get_morphology_from_definitions() and _get_morphology_from_repo()
| * morphlib/sourceresolver.py: Do not duplicate what is already done in ↵Javier Jardón2015-03-041-8/+3
| | | | | | | | load_from_string()
| * morphlib/morphloader.py: Add a check to load_from_string()Javier Jardón2015-03-041-1/+5
| |
| * morphlib/morphloader.py: Update copyrigthJavier Jardón2015-03-041-1/+1
| |
| * morphlib/sourceresolver.py: Add _get_file_contents()Javier Jardón2015-03-041-12/+23
| | | | | | | | And make _get_morphology() use it
| * morphlib/sourceresolver.py: Add _get_file_contents_from_definitions()Javier Jardón2015-03-041-1/+10
| | | | | | | | And make _get_morphology_from_definitions() use it
| * morphlib/sourceresolver.py: Add _get_file_contents_from_repo()Javier Jardón2015-03-041-5/+11
| | | | | | | | And make _get_morphology_from_repo() use it
| * Add check for virtual networksRichard Ipsum2015-03-041-0/+48
| | | | | | | | An exception will be raised if any needed networks are not started
| * Check file can be created at locationRichard Ipsum2015-03-041-1/+22
| |
| * distbuild: Be more robust when a worker disconnectsSam Thursfield2015-03-041-8/+35
| | | | | | | | | | | | | | | | | | The logic to handle a worker disconnecting was broken. The WorkerConnection object would remove itself from the main loop as soon as the worker disconnected. But it would not get removed from the list of available workers that the WorkerBuildQueue maintains. So the controller would continue sending messages to this dead connection, and the builds it sent would hang forever for a response.
| * Only update Git submodules in cache when necessarySam Thursfield2015-03-043-66/+65
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This saves a duplicate `git remote update origin` that was being run as part of each chunk build. For any repos that have submodules, it also avoids updating repos if the SHA1 we need to build is already present locally. As well as speeding up builds slightly, this means Morph can now build without being connected to a network, as long as the local Git cache all of the necessary repos and commits in the build, without needing the '--no-git-update' option. The code is also now in a more logical place than before.
| * Fix copyright yearsSam Thursfield2015-03-041-1/+1
| |
* | Merge remote-tracking branch 'petefoth/pf_copyright_in_help'Sam Thursfield2015-03-059-1/+127
|\ \ | | | | | | | | | | | | | | | Reviewed-By: Pedro Alvarez <pedro.alvarez@codethink.co.uk> Reviewed-By: Javier Jardón <javier.jardon@codethink.co.uk> Reviewed-By: Sam Thursfield <sam.thursfield@codethink.co.uk>
| * | Add copyright headers to write.help and configure.help filesPete Fotheringham2015-03-059-1/+127
| | |
* | | Merge branch 'jjardon/versioning_support'Javier Jardón2015-03-042-31/+65
|\ \ \ | | | | | | | | | | | | | | | | | | | | Reviewed-By: Paul Sherwood <paul.sherwood@codethink.co.uk> Reviewed-By: Sam Thursfield <sam.thursfield@codethink.co.uk> Reviewed-By: Richard Maw <richard.maw@gmail.com>
| * | | morphlib/sourceresolver.py: Check and parse VERSION filejjardon/versioning_supportJavier Jardón2015-03-031-0/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Only fail if: - VERSION file exists - and its a yaml file - and its a dict - and has the key 'version' - and the contents of the key 'version' is an int - and that int is in the list of non_supported_versions (empty at the moment)
| * | | morphlib/sourceresolver.py: Remove not used functionsJavier Jardón2015-02-271-16/+0
| | | | | | | | | | | | | | | | _get_morphology_from_definitions() and _get_morphology_from_repo()
| * | | morphlib/sourceresolver.py: Do not duplicate what is already done in ↵Javier Jardón2015-02-271-8/+3
| | | | | | | | | | | | | | | | load_from_string()
| * | | morphlib/morphloader.py: Add a check to load_from_string()Javier Jardón2015-02-271-1/+5
| | | |
| * | | morphlib/morphloader.py: Update copyrigthJavier Jardón2015-02-271-1/+1
| | | |
| * | | morphlib/sourceresolver.py: Add _get_file_contents()Javier Jardón2015-02-271-12/+23
| | | | | | | | | | | | | | | | And make _get_morphology() use it
| * | | morphlib/sourceresolver.py: Add _get_file_contents_from_definitions()Javier Jardón2015-02-271-1/+10
| | | | | | | | | | | | | | | | And make _get_morphology_from_definitions() use it
| * | | morphlib/sourceresolver.py: Add _get_file_contents_from_repo()Javier Jardón2015-02-271-5/+11
| | | | | | | | | | | | | | | | And make _get_morphology_from_repo() use it
* | | | Merge remote-tracking branch 'origin/baserock/richardipsum/kvm-ext-more-checks'Richard Maw2015-03-041-1/+70
|\ \ \ \ | |_|/ / |/| | | | | | | | | | | | | | | Reviewed-by: Pedro Alvarez Reviewed-by: Francisco Redondo Marchena Reviewed-by: Richard Maw
| * | | Add check for virtual networksRichard Ipsum2015-01-291-0/+48
| | | | | | | | | | | | | | | | An exception will be raised if any needed networks are not started
| * | | Check file can be created at locationRichard Ipsum2015-01-291-1/+22
| | | |
* | | | Merge branch 'sam/distbuild-worker-disconnect'Sam Thursfield2015-03-031-8/+35
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | Reviewed-By: Richard Maw <richard.maw@codethink.co.uk> Reviewed-By: Francisco Redondo Marchena <francisco.marchena@codethink.co.uk> Reviewed-By: Mike Smith <mike.smith@codethink.co.uk>
| * | | | distbuild: Be more robust when a worker disconnectsSam Thursfield2015-02-031-8/+35
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The logic to handle a worker disconnecting was broken. The WorkerConnection object would remove itself from the main loop as soon as the worker disconnected. But it would not get removed from the list of available workers that the WorkerBuildQueue maintains. So the controller would continue sending messages to this dead connection, and the builds it sent would hang forever for a response.
* | | | | Merge branch 'sam/fewer-submodule-updates'Sam Thursfield2015-03-033-66/+65
|\ \ \ \ \ | |_|_|/ / |/| | | | | | | | | | | | | | Reviewed-By: Javier Jardón <javier.jardon@codethink.co.uk> Reviewed-By: Richard Maw <richard.maw@codethink.co.uk>
| * | | | Only update Git submodules in cache when necessarySam Thursfield2015-02-103-67/+66
| |/ / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This saves a duplicate `git remote update origin` that was being run as part of each chunk build. For any repos that have submodules, it also avoids updating repos if the SHA1 we need to build is already present locally. As well as speeding up builds slightly, this means Morph can now build without being connected to a network, as long as the local Git cache all of the necessary repos and commits in the build, without needing the '--no-git-update' option. The code is also now in a more logical place than before.
* | | | Fix copyright yearsSam Thursfield2015-02-271-1/+1
| | | |
* | | | Merge remote-tracking branch 'origin/sam/disable-new-btrfs-features'Sam Thursfield2015-02-271-1/+25
|\ \ \ \ | | |_|/ | |/| | | | | | | | | | Reviewed-By: Pedro Alvarez <pedro.alvarez@codethink.co.uk> Reviewed-By: Zara Zaimeche <zara.zaimeche@codethink.co.uk>
| * | | Fix Morph producing unbootable systemsSam Thursfield2015-02-261-1/+25
|/ / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Since the version of btrfs-progs in the Baserock reference system definitions was updated to v3.18.2, Morph has produced unbootable x86 systems. This is down to lack of support for new Btrfs features in SYSLINUX. This patch disables the new features so that deployed systems will boot. Although I generally don't want to have compatibility code in Morph, this patch keeps support for the old mkfs.btrfs (which doesn't support the commandline options that we need to pass to new mkfs.btrfs). This will hopefully save people from suffering 'I need to use new Morph to upgrade my devel system, but new Morph doesn't run on my devel system'.
* | | Merge branch 'sam/sourceresolver-fixes'Sam Thursfield2015-02-254-87/+138
|\ \ \ | | | | | | | | | | | | | | | | Reviewed-By: Paul Martin <paul.martin@codethink.co.uk> Reviewed-By: Francisco Redondo Marchena <francisco.marchena@codethink.co.uk>
View Lorry Controller Status