summaryrefslogtreecommitdiff
path: root/morphlib
Commit message (Collapse)AuthorAgeFilesLines
* Refactor SystemBuilder and add helper classLars Wirzenius2012-03-023-126/+337
| | | | | | | | The helper class, Factory, has unit tests, which is why it's currently separate. It may later get integrated with BlobBuilder, or the other way around. Classes that don't have unit tests are marked out of coverage.
* Remove unnecessary import of time moduleLars Wirzenius2012-02-281-1/+1
|
* Add comment explaining PATH trickery when running ldconfigLars Wirzenius2012-02-281-0/+7
|
* Builder.build and build_single also do not need to return values anymoreLars Wirzenius2012-02-281-6/+1
|
* Remove unused needs_built methodLars Wirzenius2012-02-281-4/+0
|
* Use Tempdir.remove instead of rm, and drop unused Tempdir.clearLars Wirzenius2012-02-282-21/+0
| | | | | | | | If the remove method is insufficient (because it gets run as non-root, but some of the stuff needs root to remove them), then we need to fix the method, not replace it with other things. The Tempdir.clear method was not used anywhere, so YAGNI and removed it.
* Refactor tests to share more common codeLars Wirzenius2012-02-281-15/+18
|
* Remove pointless empty directory from testLars Wirzenius2012-02-281-2/+0
|
* Document why test ignore directory size and mtimeLars Wirzenius2012-02-281-0/+11
|
* Remove version numberLars Wirzenius2012-02-281-3/+0
| | | | | | We don't do releases, so having the version number in the source is misleading. If and when we start doing numbered releases, it's easy to add back. However, YAGNI and all that.
* Set sensible defaults for git-base-url, bundle-server, cachedir, max-jobsLars Wirzenius2012-02-281-4/+1
| | | | | | | | | | | | | | Also, change builder.py to always obey the --max-jobs setting, unless a morphology has a max-jobs field. The defaults have been chosen so that they work for everyone equally well. It may be useful to have a local mirror and then set the options to point there, but it's not reasonable to try to guess such things, so the defaults can be adapated to that. Collect the defaults into one place so they're easier to overview. The cliapp interface for adding settings is verbose enough that the defaults were getting buried.
* Remove unnecessary parenthesesLars Wirzenius2012-02-271-2/+2
|
* Remove unnecessary unittest tearDown methodLars Wirzenius2012-02-271-3/+0
|
* Make ./check check for long lines (with excptions); fix long linesLars Wirzenius2012-02-273-5/+8
|
* Remove the system testing subcommands and related codeLars Wirzenius2012-02-272-156/+0
| | | | | | | | This we a proof-of-concept, and we want to explore various options of how to do this, so let's not keep the code in morph. The code also has no tests, so it is already likely to have bit-rotted. If we decide we want to, we can always resurrect it from git history.
* Create chunks, strata in cache via temporary filesLars Wirzenius2012-02-279-22/+235
| | | | | This avoids problems with files with the right names but partial content, if morph is killed in the middle of writing the file.
* Hide git output from unit test outputLars Wirzenius2012-02-272-4/+6
| | | | | | | | | | | | This makes it easier to check the output with vgrep for errors or problems. Voluminous git output made that hard. The key is that "git bundle create" has no --quiet optio (meh), so we have to redirect stderr to /dev/null. However, that would hide real errors, which we want to catch. Luckily, we can just replace the call to subprocess.call with a call to subprocess.check_call, and then we'll at least abort if there's an error, instead of silently ignoring it.
* morph: drop special case .git in mtime settingRichard Maw2012-02-271-6/+4
| | | | | | | | | | | | | Either all .gits need to be left alone, including submodules, or all of them get changed. Doing all gets surprisingly complicated, as bottom-up traversal is needed for directories to have their mtimes set, which means that either we check the path for a .git component, or we do our own traversal function, to top-down exclude .git and bottom-up set mtimes. This is more effort than it is worth when git probably doesn't care so let's just drop it entirely.
* morph: use right dir for set mtimeRichard Maw2012-02-271-1/+1
|
* morph: set mtime after submodule extractRichard Maw2012-02-271-1/+1
| | | | | | | | Setting mtimes can fail if it is a symbolic link and it points to a non-existant file. This has happened when we had symbolic links pointing to files in a submodule, so we set mtimes after submodules have been checked out.
* Apply the test changes of the previous commit to all related tests.Jannis Pohlmann2012-02-241-2/+6
|
* Merge remote branch 'origin/master'Lars Wirzenius2012-02-242-21/+17
|\
| * Rework the bundle code to set the bundle filename outside _wget().Jannis Pohlmann2012-02-242-24/+14
| | | | | | | | | | This is a bit stupid and requires tests to be adjusted (which is done in this commit as well).
| * Make sure to always remove bundles on errors or when we've cloned them.Jannis Pohlmann2012-02-241-0/+6
| |
* | Exclude the .git directory from mtime changing, just in caseLars Wirzenius2012-02-241-5/+7
| |
* | Set mtime of all files after git checkout of source tree for buildingLars Wirzenius2012-02-241-0/+19
|/
* Make sure to remove cached git dirs if cloning/extracting fails.Jannis Pohlmann2012-02-221-1/+5
|
* Use "cp -a" and "git checkout" to unpack sources in the build tree.Jannis Pohlmann2012-02-222-13/+25
| | | | | | | | | This is done to keep the git repository intact with history and all that. cp + checkout turns out to be faster than a regular "git clone". In order to avoid roundtrips to the internet whenever a chunk tries to do something with submodules, we force the submodule URLs to point to our locally cached repos.
* Improve log messages and warnings when caching repos.Jannis Pohlmann2012-02-221-2/+3
|
* Fix exception when updating a cached clone in _cache_repo_from_url().Jannis Pohlmann2012-02-221-0/+1
|
* builder.py: use sh -c instead of writing a scriptRichard Maw2012-02-211-11/+2
| | | | | | | | | | | | | | | | Putting the commands in a file made it more difficult to tell what happened in scripts, until the self.msg was added. After then it made the commands more difficult to reproduce So if it can safely be done in a single command it should be more readable. This approach uses sh -c to cd then evaluate the remaining options The command is 'cd "$1" && shift && eval "$@"', then passes the command as arguments to the shell script, so the program does not need to do any escaping of strings. If the commands were a list of strings instead of a quoted string then it would be a bit safer, but less flexible for use.
* Delay bundle and base URL errors until we are sure all of them failed.Jannis Pohlmann2012-02-201-15/+21
| | | | | | | This is done to not print confusing errors in situations where one of the bundles or base URLs works and everything is fine. If all of them are failing though, we now print all the error messages in order to give users an overview over what might have gone wrong.
* Update quote_url() to replace : with _.Jannis Pohlmann2012-02-201-4/+9
|
* Handle empty/short lines when validating submodulesLars Wirzenius2012-02-171-1/+1
|
* Add Assert to make sure the destdir muckery is safeLars Wirzenius2012-02-171-0/+1
|
* Remove staging path prefix from $DESTDIR when we run things in chrootLars Wirzenius2012-02-171-0/+7
|
* Show the commands to be run in chrootLars Wirzenius2012-02-171-0/+1
|
* Merge branch 'master' of gitorious.org:baserock/morphLars Wirzenius2012-02-161-1/+2
|\
| * build-system: autotools now runs autoreconfRichard Maw2012-02-161-1/+2
| |
* | Use a colon-less local filename for saved bundlesLars Wirzenius2012-02-161-0/+1
| | | | | | | | Otherwise we have to deal with git's not liking colons in filenames.
* | Fix how ldconfig is runLars Wirzenius2012-02-161-2/+2
| | | | | | | | Now it should actually work.
* | Build non-bootstrap chunks inside a staging chrootLars Wirzenius2012-02-161-4/+27
|/ | | | | | This adds options --staging-filler and --staging-chroot. The wisdom of these options needs to be re-considered at some point, but for now they're OK.
* Fix overriding of build system commandsLars Wirzenius2012-02-151-1/+15
| | | | | This time, with testing. For a five line method, this was surprisingly tricky to get right. Should sleep properly at night...
* Allow *-commands to override commands provided by build systemLars Wirzenius2012-02-151-18/+25
| | | | | | | | | | | | | This allows us to do this: "build-system": "autotools", "configure-commands": [ "./configure --prefix=$PREFIX --disable-nls --enable-foo" ] The explicit command is used for configure, but the commands provided by the autotools build-system will be used for build-commands, test-commands, and install-commands.
* Log whenever updating origin fails.Jannis Pohlmann2012-02-141-0/+1
|
* Switch to caching repos without checking them out.Jannis Pohlmann2012-02-141-5/+6
| | | | | | | | | | | | | This is almost as good as --bare. But unlike --bare, it properly sets up the 'origin' remote and creates the 'refs/remotes/origin/...' branches. When cloning with --bare, and you end up with "refs/heads/master", not "/refs/remotes/origin/master". You can re-add the remote 'origin', still no "refs/remotes/origin/master". Only after you update the remote (after re-adding it), the bare clone has "refs/remotes/origin/master"... and a "refs/heads/master" that is out of sync. An ugly mix, basically. So maybe this approach is better.
* Revert "Add --prefix option, adjust autotools system and env variables."Jannis Pohlmann2012-02-141-26/+6
| | | | This reverts commit 63cab3e0e2f550a0bfe470d018063a8b91a759bd.
* Revert "Set environment variables needed to build in a different prefix."Jannis Pohlmann2012-02-141-21/+19
| | | | This reverts commit e0fb97f08156af97ec2341ec8061fe514ae358e5.
* Ignore remote update failures in bootstrap mode.Jannis Pohlmann2012-02-141-1/+3
| | | | | | This is needed because if there are any connection errors during bootstrap, we do not want that to affect the build. It is mostly a hack that should not be necessary. But it is and that's life.
* Drop an unnecessary print statement.Jannis Pohlmann2012-02-141-1/+0
|
View Lorry Controller Status