summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Update the help text for morph deploybaserock/adamcoldrick/deploy-specific-systemsAdam Coldrick2014-05-231-5/+4
|
* Allow the user to specify deployments in a clusterAdam Coldrick2014-05-231-6/+18
| | | | | | | | | | | Instead of taking the name of a cluster morphology and zero or more parameters for overriding the cluster morphology, morph deploy should take the name of a cluster morphology and the names of zero or more system deployments that are defined in the cluster morphology. If no deployment names are given then all deployments are deployed. The parameters can still be passed in the same format as before using the `--param="SYSTEM.KEY=VALUE"` option.
* Validate cluster morphologiesAdam Coldrick2014-05-231-1/+17
| | | | | The names of deployments in cluster morphologies will need to be unique in order for the deployment of selected systems to work.
* Don't validate when loading all morphologiesAdam Coldrick2014-05-231-1/+3
| | | | | | | This validation happened due to confusion regarding using morph to checkout baserock:baserock/morph rather than baserock:baserock/morphs. Since we now use baserock:baserock/definitions, this confusion will no longer occur.
* Fix long lineDaniel Silverstone2014-05-161-1/+2
|
* Merge branch 'baserock/danielsilverstone/vagrant-support'Daniel Silverstone2014-05-162-8/+16
|\
| * Fix state subvolume generator to preserve permissionsbaserock/danielsilverstone/vagrant-supportDaniel Silverstone2014-05-161-1/+1
| | | | | | | | | | | | shutil.move() does not preserve permissions, file modes, ownerships etc, resulting in much confusion when prepopulating a non-root user during deployment. This change to `mv` fixes that.
| * VirtualBox Write Extension: Vagrant supportDaniel Silverstone2014-05-161-7/+15
|/ | | | | | | Add support to the VirtualBox write extension to notice if we are doing a Vagrant Basebox installation and not do the clever network setup we normally do to allow machines to talk to one another since this confuses Vagrant quite a bit if it is left in.
* Update NEWS for Baserock 14.20 releasebaserock-14.20Sam Thursfield2014-05-141-0/+22
|
* Update README for Baserock 14.20 releaseSam Thursfield2014-05-141-12/+8
|
* Merge remote-tracking branch 'origin/sam/distbuild-logs-2'Sam Thursfield2014-05-141-0/+1
|\ | | | | | | | | Reviewed-By: Richard Ipsum <richard.ipsum@codethink.co.uk> Reviewed-By: Lars Wirzenius <lars.wirzenius@codethink.co.uk>
| * distbuild: Include .build-log when copying chunk artifacts to the TroveSam Thursfield2014-05-141-0/+1
| | | | | | | | | | Users need to be able to see logs of all builds, not just those that failed.
* | Merge branch 'sam/distbuild-morphology'Sam Thursfield2014-05-141-0/+23
|\ \ | | | | | | | | | Reviewed-By: Richard Ipsum <richard.ipsum@codethink.co.uk>
| * | Add distbuild-morphology command.Sam Thursfield2014-05-141-0/+23
|/ / | | | | | | | | | | | | | | | | This is useful to build releases using distbuild. It avoids having the SHA1 fields in the artifact metadata files pointing to commits that exist only on temporary build branches. It also avoids file:// URLs in the repo fields. Note that the repo URL still points to the Trove used by the distbuild network, rather than being an upstream URL pointing to git.baserock.org.
* | Merge branch 'baserock/richardipsum/build-log-on-stdout-tee2'Richard Ipsum2014-05-146-26/+74
|\ \ | |/ |/| | | | | | | | | Reviewed by: Lars Wirzenius Sam Thursfield Daniel Silverstone
| * Make distbuild put worker logs onto stdoutRichard Ipsum2014-05-141-0/+1
| |
| * Use logfile kwarg to generate build logRichard Ipsum2014-05-141-24/+47
| | | | | | | | | | | | | | | | | | We could just set stdout to subprocess.PIPE then read from the pipe, but then we won't get the output till the command's finished and some commands take a long time. Using the logfile kwarg a file will be created by tee and the output will be written to it in 'real time'.
| * Add logfile kwarg to staging area runcmdRichard Ipsum2014-05-141-1/+8
| | | | | | | | | | | | | | | | | | | | | | | | We use tee to write the output to a file as well as to stdout. Using Popen it should be straight forward to send the output to a pipe and then read that pipe and write to wherever. At the moment morph uses cliapp's runcmd rather than Popen. cliapp's runcmd is a blocking call, so we're not able to read from the pipe until the command has completed, which prevents real time logging to a number of files. One solution to this problem might be to spawn a thread which opens a pipe to the command being executed, the thread then reads from the pipe and writes to our collection of logfiles.
| * Add --build-log-on-stdout flagRichard Ipsum2014-05-141-0/+3
| |
| * Add test for get_source_metadata_filenameRichard Ipsum2014-05-141-0/+11
| |
| * Add get_source_metadata_filenameRichard Ipsum2014-05-141-1/+4
| |
* | Add help for install-files.configureRichard Ipsum2014-05-092-28/+60
|/ | | | | Move the help out of the comment and into a help file, and add a clearer example.
* Merge branch 'baserock/richardipsum/distbuild_cancel2'Richard Ipsum2014-05-073-29/+158
|\ | | | | | | | | | | | | Reviewed by: Richard Maw Lars Wirzenius Daniel Silverstone
| * Add _ExecFailed eventRichard Ipsum2014-05-061-4/+24
| | | | | | | | To cancel jobs cleanly we need to know when a job has failed.
| * Use messages to update job stateRichard Ipsum2014-05-061-3/+24
| |
| * Add cancelling to WorkerBuildSchedulerRichard Ipsum2014-05-061-13/+93
| |
| * Remove unused import and methodRichard Ipsum2014-05-061-3/+0
| | | | | | | | add_initiator() isn't necessary given lists have a remove method.
| * Rename vars in dequeue_eventsRichard Ipsum2014-05-061-2/+2
| |
| * Add cancelling to build controllerRichard Ipsum2014-05-051-7/+19
| |
| * Remove route mapRichard Ipsum2014-04-241-1/+0
| |
* | Fix bad indentationRichard Ipsum2014-05-071-2/+2
| |
* | A more useful morphology syntax error messageRichard Ipsum2014-05-071-4/+3
| | | | | | | | | | There's no longer any need to log the exception separately, it will be logged with the MorphologySyntaxError
* | Merge branch 'baserock/richardipsum/improve_copyright_check'Richard Ipsum2014-04-282-15/+11
|\ \ | |/ |/| | | | | | | Reviewed by: Daniel Silverstone Richard Maw
| * Exit check as soon as we have an errorRichard Ipsum2014-04-251-6/+2
| |
| * Improve check-copyright-year error reportingRichard Ipsum2014-04-251-9/+9
|/ | | | Be more verbose and exit with an error not an exception.
* Merge branch 'baserock/richardipsum/distbuild_jobs'Richard Ipsum2014-04-246-103/+262
|\ | | | | | | | | | | | | Reviewed by: Sam Thursfield Richard Maw Lars Wirzenius
| * Import all the thingsRichard Ipsum2014-04-231-1/+4
| |
| * Initiator: Handle step-already-started messageRichard Ipsum2014-04-231-0/+7
| |
| * InitiatorConnection: Handle _step_already_startedRichard Ipsum2014-04-231-1/+21
| |
| * Check whether request id is in the event's id listRichard Ipsum2014-04-231-6/+8
| | | | | | | | | | | | The contents of the message has changed for several events, event messages that need to be sent to several initiators have a list of ids instead of a single id.
| * Add handling for new messages to BuildControllerRichard Ipsum2014-04-231-1/+40
| | | | | | | | | | | | | | | | | | | | | | | | | | | | There are two new messages: WorkerBuildStepAlreadyStarted tells the initiator that the artifact they want to build is already being built, e.g. 'eglibc-misc is already building on 172.17.1.37:3434' WorkerBuildWaiting tells the initiator that the artifact they want to build can't be built yet because there aren't any workers free, e.g. 'Ready to build eglibc-misc: waiting for a worker to become available'
| * Add new step-already-started message to protocolRichard Ipsum2014-04-231-0/+5
| |
| * WorkerConnection: _maybe_handle_helper_resultRichard Ipsum2014-04-231-9/+4
| | | | | | | | | | | | | | Put our _exec_response_msg into WorkerBuildFinished event, it's essentially the same as _finished_msg, just a different name Get our artifact's cache key from the job
| * WorkerConnection: _request_cachingRichard Ipsum2014-04-231-9/+6
| | | | | | | | Now we just get everything from the job object
| * WorkerConection: _handle_exec_responseRichard Ipsum2014-04-231-9/+8
| | | | | | | | | | | | | | | | | | | | | | The exec_response_msg also needs to be sent to a number of initiators, so we give it a list of ids not just one. The exec_response_msg will be sent to the controller once the artifacts have been cached successfully. There's no longer any need to use a route map to retrieve the id of the initiator, since this is stored with the job
| * WorkerConnection: _handle_exec_outputRichard Ipsum2014-04-231-2/+2
| | | | | | | | | | msg now contains a list of initiator ids rather than a single one, since BuiltOutput needs to be sent to a number of initiators
| * WorkerBuildQueuer: Use job's artifact and idRichard Ipsum2014-04-231-14/+17
| | | | | | | | | | | | Each job is given a unique id, so we don't need to generate an id for each exec request this means we can remove use of route map since we can use the job's id for the exec request
| * Remove cancelRichard Ipsum2014-04-231-6/+1
| | | | | | | | This method no longer works, we will replace it soon.
| * Change event names backRichard Ipsum2014-04-231-3/+3
| | | | | | | | | | The name change from BuildFailed -> JobFailed etc was unintentionally merged into master, undo this.
| * WorkerConnection: misc attributesRichard Ipsum2014-04-231-0/+6
| | | | | | | | | | | | _job is the job this worker is carrying out _exec_response_msg will contain the response the worker sends back to us when it finishes the build.