summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * WorkerBuildQueuer: replace request queue with jobsRichard Ipsum2014-04-231-25/+67
| |
| * Add Jobs and Job classesRichard Ipsum2014-04-231-10/+49
| |
| * Make WorkerBuildCaching carry a list of idsRichard Ipsum2014-04-231-5/+2
| | | | | | | | We need to be able to send this message to a number of initiators
| * Add new build messages to worker build schedulerRichard Ipsum2014-04-231-2/+12
| |
* | Merge remote-tracking branch ↵Richard Maw2014-04-221-2/+2
|\ \ | | | | | | | | | | | | | | | | | | 'origin/baserock/ps/fix-virtualbox-version-checking' Reviewed-by: Richard Maw Reviewed-by: Pedro Alvarez
| * | fix the Virtualbox version checkingPaul Sherwood2014-04-201-2/+2
| | |
* | | Update copyright header in check-silliness scriptRichard Maw2014-04-221-1/+1
|/ / | | | | | | | | Reviewed-by: Pedro Alvarez Rubber-stamped-by: Richard Maw
* | Merge remote-tracking branch 'origin/baserock/richardmaw/style-checker'Richard Maw2014-04-172-5/+23
|\ \ | | | | | | | | | | | | Reviewed-by: Lars Wirzenius Reviewed-by: Daniel Silverstone
| * | style check: Include newly added files in checksRichard Maw2014-03-191-2/+3
| | |
| * | check-copyright-year: Use current date for uncommitted changesRichard Maw2014-03-191-3/+20
| | |
* | | Fix check-silliness' use of awk length functionLars Wirzenius2014-04-171-2/+2
| | | | | | | | | | | | | | | | | | | | | Posix took away using length without (). Reviewed-by: Richard Maw Reviewed-by: Daniel Silverstone
* | | Remove duplicated function _artifact_filenameRichard Ipsum2014-04-161-8/+2
| |/ |/|
* | Add flag for debugging state of build graphRichard Ipsum2014-04-161-8/+10
| | | | | | | | | | | | Most of the time knowing the state of the build graph isn't that useful for debugging distbuild, but it may be useful in some situations.
* | Don't log a cache response till we're sureRichard Ipsum2014-04-161-1/+2
| | | | | | | | | | | | The controller should check the response event is actually the response it was waiting for before logging that there was a cache response
* | Merge branch 'baserock/richardipsum/distbuild_improve_annotation3'Richard Ipsum2014-04-154-57/+83
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: distbuild/build_controller.py Reviewed by: Lars Wirzenius Daniel Silverstone Sam Thursfield
| * | Annotation using single post requestRichard Ipsum2014-04-111-53/+70
| | | | | | | | | | | | We now get the state of all artifacts with a single request.
| * | Set body and headers in messageRichard Ipsum2014-04-111-1/+2
| | | | | | | | | | | | body and headers must now be specified for http-request message.
| * | Request has headers and body. Allow POST methodRichard Ipsum2014-04-111-2/+8
| | |
| * | Add body and headers to http-request messageRichard Ipsum2014-04-081-0/+2
| | |
* | | Merge branch 'baserock/sam/deploy-kvm-check'Sam Thursfield2014-04-154-12/+60
|\ \ \ | | | | | | | | | | | | Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
| * | | deploy: Extra checks for KVM deploymentsSam Thursfield2014-04-151-0/+21
| | | | | | | | | | | | | | | | | | | | Test that a VM with the given name does not already exist, and check that the files specified in ATTACH_DISKS do already exist.
| * | | deploy: Share SSH connectivity check in the common writeexts.py codeSam Thursfield2014-04-153-10/+11
| | | | | | | | | | | | | | | | | | | | Also, change it to log the real error message in morph.log before raising a more general exception to the user.
| * | | deploy: Check SSH connection for KVM deployment before startingSam Thursfield2014-04-142-6/+32
|/ / / | | | | | | | | | | | | | | | Slight duplication is necessary, but it's only a few lines. We could move the duplicated code into the base class in 'morphlib.writeexts' if there was more duplication.
* | | Fix lines longer than 80 characters (my fault)Sam Thursfield2014-04-143-5/+8
| | |
* | | Merge branch 'sam/distbuild-concurrency-fixes'Sam Thursfield2014-04-1411-60/+87
|\ \ \ | | | | | | | | | | | | Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
| * | | distbuild: Consistently name all maybe_ message callbacksSam Thursfield2014-04-142-25/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | There are cases where a state machine handles an event but stays in the same state. A callback is registered which filters messages further before possibly taking action. There have been bugs caused by this pattern being incorrectly implemented (where the callback is expected to filter the message, but a transition takes place anyway). Hopefully a consistent naming convention will make the pattern clearer.
| * | | distbuild: Make some transitions more specificSam Thursfield2014-04-142-23/+18
| | | | | | | | | | | | | | | | | | | | | | | | There is always one BuildController object per InitiatorConnection. By coupling the objects slightly closer we can simplify some transitions in BuildController.
| * | | distbuild: Fix possible 'one user disconnecting breaks all builds' issueSam Thursfield2014-04-141-2/+2
| | | | | | | | | | | | | | | | | | | | This is similar to the issue fixed by commit c38b77bed86acc8b90f253ce354f3ecf98e475e7.
| * | | distbuild: Fix 'one build failure causes all concurrent builds to hang'Sam Thursfield2014-04-141-8/+25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Each BuildController instance sets itself up to receive all messages from all workers (via the WorkerConnection instances). In the case of a build failure, all BuildController objects would transition to 'None' state (causing them all to be destroyed) on any WorkerBuildFailed message. This meant that if any one build failed on a distbuild network: - the user whose build actually failed would receive the error messages correctly - any concurrent users would see no further build messages from the controller, making it look like their builds had hung. Ctrl+C from the 'hung' users would still be correctly handled by the controller, as their InitiatorConnection instance would still be alive.
| * | | distbuild: Clarify InitiatorConnection docstringSam Thursfield2014-04-141-3/+6
| | | |
| * | | distbuild: Label state machine transition tablesSam Thursfield2014-04-1411-0/+12
| | | | | | | | | | | | | | | | Makes it easier to see what they mean at a glance.
| * | | distbuild: worker-build failure does not indicate an error in the controllerSam Thursfield2014-04-141-1/+1
|/ / /
* | | Merge branch 'sam/distbuild-logging-improvements'Sam Thursfield2014-04-1413-47/+125
|\ \ \ | | | | | | | | | | | | | | | | Reviewed-By: Richard Ipsum <richard.ipsum@codethink.co.uk> Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
| * | | distbuild: Log IPs of initiators and workers in more placesSam Thursfield2014-04-102-32/+31
| | | | | | | | | | | | | | | | This makes tracking multiple builds through one log file a bit easier.
| * | | distbuild: Improve logging of connections and objectsSam Thursfield2014-04-1010-8/+94
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | New DistbuildSocket class that wraps socket.socket(), providing a descriptive repr() handler showing where the socket is connected, and providing a couple of helper methods for fetching local and remote endpoint names. This commit also adds a descriptive repr() handler to a few other objects (mostly giving socket connection details).
| * | | distbuild: Remove debug logging from serialise-artifact codeSam Thursfield2014-04-101-7/+0
| | | | | | | | | | | | | | | | | | | | We still log all messages sent to workers, which include the output of the serialise-artifact code in full. There's no need for these status messages.
| * | | distbuild: Disable extra debugging by defaultSam Thursfield2014-04-102-2/+2
| | | |
* | | | Merge branch 'sam/distbuild-gc-fix'Sam Thursfield2014-04-141-6/+14
|\ \ \ \ | |/ / / |/| | | | | | | Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
| * | | distbuild: Stop workers blowing their entire cache away every timeDaniel Silverstone2014-04-141-6/+14
|/ / /
* | | Merge branch 'sam/tweak-no-origin-error'Sam Thursfield2014-04-091-6/+8
|\ \ \ | | | | | | | | | | | | Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
| * | | Tweak some user-facing error messages in 'gitdir'Sam Thursfield2014-04-081-6/+8
|/ / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The default Python __repr__() is useless for both developers and users, so avoid using it in error messages. The following message: ERROR: Push to remote <morphlib.gitdir.Remote object at 0x905096c>, push url None with refspecs (<morphlib.gitdir.RefSpec object at 0xf72fec2c>,) failed with exit code 128 Becomes: ERROR: Push to remote "origin", push url None failed with exit code 128
* | | Merge branch 'baserock/pedroalvarez/extra-kernel-args'Pedro Alvarez2014-04-041-1/+5
|\ \ \ | |/ / |/| |
| * | Adding support to add extra kernel args in extlinux.confPedro Alvarez2014-04-041-1/+5
|/ /
* | Merge branch 'baserock/adamcoldrick/git-fat-handle-whitespace-rebase'Adam Coldrick2014-04-031-1/+21
|\ \ | | | | | | | | | | | | | | | | | | | | | Signed-off by: Adam Coldrick Reviewed by: Daniel Silverstone <daniel.silverstone@codethink.co.uk> Richard Maw <richard.maw@codethink.co.uk>
| * | Escape special characters and handle whitespace in gitattributesbaserock/adamcoldrick/git-fat-handle-whitespace-rebaseAdam Coldrick2014-04-021-1/+21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Since git's parsing of .gitattributes can't deal with spaces, or even with quotes, replace any whitespace with [[:space:]]. Also, make sure to escape any glob metacharacters to avoid accidental pattern matches. Note: This approach could cause a file "foo<tab>bar" to be treated as a binary if a file "foo bar" has already been added with morph add-binary. However this is as good of a workaround as I can find. Signed-off by: Adam Coldrick
* | | Use larger buffer in _relay_exec_outputRichard Ipsum2014-04-011-1/+1
| | |
* | | Merge remote-tracking branch ↵Lars Wirzenius2014-03-318-75/+246
|\ \ \ | | | | | | | | | | | | 'origin/baserock/markdoffman/s10617/add-yaml-help-option'
| * | | Add help files for nfsboot, rawdisk and tar.baserock/markdoffman/s10617/add-yaml-help-optionMark Doffman2014-04-013-0/+24
| | | | | | | | | | | | | | | | | | | | | | | | Begin adding help documentation for configuration and write extensions starting with nfsboot.write, rawdisk.write and tar.write.
| * | | Add write and configuration extensions to help.Mark Doffman2014-03-311-32/+45
| | | | | | | | | | | | | | | | | | | | | | | | Add a command 'help-extensions' to list all extensions. Add the ability to find help on an extension by calling 'morph help [extension name]'.
| * | | Add utilities for listing and finding extensions.Mark Doffman2014-03-314-43/+177
|/ / / | | | | | | | | | | | | | | | | | | | | | | | | Add a module to morphlib that can list all write and configuration extensions either in morph itself or the morphology repository. The module also contains methods to find an extension filename from the name and type.