summaryrefslogtreecommitdiff
path: root/tools
Commit message (Collapse)AuthorAgeFilesLines
* Switch to uuidutils from oslo_utils libraryDavanum Srinivas2015-02-251-1/+1
| | | | | | Get rid of our copy of uuidutils.py from oslo-incubator Change-Id: Idca3581475bcd4a04ce8d3420a1b7763db15b390
* Merge "work around for until-failure"Jenkins2015-02-071-1/+11
|\
| * work around for until-failureSean Dague2015-01-161-1/+11
| | | | | | | | | | | | | | | | | | | | | | testr run --until-failure --subunit does not actually fail when a test fails, upstream bug filed at https://bugs.launchpad.net/testrepository/+bug/1411804 Work around this by reverting to old style version when running in --until-failure mode. Change-Id: Ic2b26c423e4e6c729bb1357bc901fdf1afdb083f
* | Switch to using oslo_* instead of oslo.*Davanum Srinivas2015-02-065-6/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The oslo team is recommending everyone to switch to the non-namespaced versions of libraries. Updating the hacking rule to include a check to prevent oslo.* import from creeping back in. This commit includes: - using oslo_utils instead of oslo.utils - using oslo_serialization instead of oslo.serialization - using oslo_db instead of oslo.db - using oslo_i18n instead of oslo.i18n - using oslo_middleware instead of oslo.middleware - using oslo_config instead of oslo.config - using oslo_messaging instead of "from oslo import messaging" - using oslo_vmware instead of oslo.vmware Change-Id: I3e2eb147b321ce3e928817b62abcb7d023c5f13f
* | Merge "include python-novaclient in abandon policy"Jenkins2015-01-231-2/+4
|\ \ | |/ |/|
| * include python-novaclient in abandon policySean Dague2014-12-081-2/+4
| | | | | | | | | | | | | | python-novaclient had some 6 month old stalled patches, add it to the overall abandon cleanup policy. Change-Id: I28831acc1c0cee846e79cc63138b7bc2ce8ee03d
* | remove all traces of pylint testing infrastructureDaniel P. Berrange2015-01-082-260/+0
| | | | | | | | | | | | | | | | | | | | The pylint tests have been broken for several months and the Jenkins job has also been disabled. There has been no sign of attempts to address this, so just delete what remains of the pylint support so developers don't mistakenly think it is supposed to work with patches they are submitting. Change-Id: Ifacc99e45acb0e9a72be6c31113e0cf073354f02
* | Switch to tempest-lib's packaged subunit-traceMatthew Treinish2015-01-062-308/+1
| | | | | | | | | | | | | | This commit removes the local copy of subunit-trace in nova and uses the packaged version of the utility in tempest-lib. Change-Id: I1ed2fea9ff3d8194628b722684492f8ba7a3cabb
* | Merge "Use oslo db concurrency to generate nova.conf.sample"Jenkins2014-12-181-1/+1
|\ \ | |/ |/|
| * Use oslo db concurrency to generate nova.conf.sampleJoe Gordon2014-12-151-1/+1
| | | | | | | | | | | | | | | | Make sure we include database and concurrency options in the sample config file. Change-Id: I66e68ec120cba2cee86e36aa26720199876c40a4 Closes-Bug: #1391782
* | Merge "add abandon_old_reviews script"Jenkins2014-12-021-0/+81
|\ \
| * | add abandon_old_reviews scriptSean Dague2014-11-221-0/+81
| |/ | | | | | | | | | | | | | | | | | | | | | | This is an automated script to abandon the reviews that we agreed as a community are beyond stale. No activity for 4w with a -2 on them or No activity for 4w and Jenkins doesn't have a +1 or better on it. Can be run by any core reviewer. Change-Id: I19636f04b691c0b74af306709d54b26978c19282
* | Enable pep8 on ./tools directoryBalazs Gibizer2014-11-253-24/+21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This patch fixes the pep8 issues of the tool scripts and configures tox to run pep8 on the tools directory. Two hacking rules have been modified to ignore the tool directory as both rules are checking oslo usage which is not critical in case of tools - N310 use timeutils instead of datetime module - N324 use jsonutils instead of json module The tools/xenserver directory is still excluded from pep8 as it contains scripts that are expected to run on dom0 with python2.4 therefore the following rules cannot be meaningfully followed - H231 Python 3.x incompatible 'except x,y:' construct - H233 Python 3.x incompatible use of print operator Change-Id: Icfd9e708a2ca1e421676b410e41807b2e630718f
* | Adapting pylint runner to the new message formatBalazs Gibizer2014-11-211-3/+2
|/ | | | | | | | | | | | Pareseable output format and --include-ids parameter are deprecated and ignored in the pylint version used on the gate. These functions are replaced by the --msg-template parameter. This patch changes the runner to use the new parameter so that the job can run properly on the gate Closes-Bug: #1394606 Change-Id: I1de424bae4c2b634cd0bc804cb7e81624c96a195
* remove use of explicit lockutils invocation in testsSean Dague2014-10-291-1/+1
| | | | | | | | | | | | | | Instead of passing lockutils loading explicitly in the test run command line, provide the support for individual test classes to ask that lock_path is setup with the REQUIRES_LOCKING = True class parameter. Augment all classes that currently fail without this with REQUIRES_LOCKING = True. Hopefully many of those can be individually removed in the future so we can get out of needing external locking in any of our unit tests. Change-Id: I56229e93ad61ac823646a4119a035d36c3400173
* error if we don't run any testsSean Dague2014-10-281-0/+3
| | | | | | | | | | This makes subunit-trace error out if it finds that there were no test results in the subunit stream. This guards against the case where something breaks the test toolchain and we stop running tests entirely. Copied over from equivalent code in Tempest where this has served us well. Change-Id: I765395335a68dfc7eb754317f8c45c3dfdd85949
* Revert "Switch Nova to use oslo.concurrency"Sean Dague2014-10-281-1/+1
| | | | | | | | | | | This patch made unit tests stop running (always runs 0 unit tests) we should revert and put a check in place to prevent that from happening so that we don't regress the rest of Nova trying to figure out the oslo.concurrency issue. This reverts commit 382294762b08abb1921a77b00608ac941478ce05. Change-Id: I98b04ac2a0ba67ba8af44867799317fdf95b8aff
* Switch Nova to use oslo.concurrencyDavanum Srinivas2014-10-271-1/+1
| | | | | | | Let's switch to the newly released oslo library for the processutils and lockutils. Change-Id: Icf7831261322abd0a6fc5439fe09b1d4cb614cb7
* Merge "Remove obsolete vmware/esx tools"Jenkins2014-10-202-405/+0
|\
| * Remove obsolete vmware/esx toolsDavanum Srinivas2014-10-082-405/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Our Docs have updated information in and the README is stale. http://docs.openstack.org/trunk/config-reference/content/vmware.html#vmware-prereqs The guest_tool.py was once used a long time ago to setup networking by pulling information from esx and setting the OS details in the VM. This is no longer used or needed as we have better ways to do the same using config drive or metadata service http://docs.openstack.org/trunk/config-reference/content/vmware.html#VMware_networking http://docs.openstack.org/user-guide/content/config-drive.html http://cloudinit.readthedocs.org/en/latest/topics/datasources.html#config-drive Change-Id: I8c2ba52cffbcf9be50fd0e2f7b2bb1da8089e324
* | Sync with latest oslo-incubatorDavanum Srinivas2014-10-111-1/+1
|/ | | | | | | | | | | | | | | | | | | | | | Changes include: 55ca7c3 Split cliutils 1b44601 Allow dictionary lookup in credentials with dot notation 6c706c5 Delete graduated serialization files 3edbfb3 remove caching param from prettytable call 9ce1d96 Fix i18n import 5d40e14 Remove code that moved to oslo.i18n a4be4ed Remove graduated config modules 6ff6b4b Switch oslo-incubator to use oslo.utils and remove old modules 70189c9 Remove graduated test and fixtures libraries 8b71f57 Delete graduated db files 6ede600 rpc, notifier: remove deprecated modules 6b65a41 Fix build break - switch from str to hash for lookup f76f44c Delete the token and endpoint on expiry of token of client aebb58f Fix typo to show correct log message 1131b56 Enabled mask_password to handle byte code strings 6b048e7 Let oslotest manage the six.move setting for mox Change-Id: Ic588aec0fc0291440feaac3439836054bd3608cd
* Use oslo.utilsDavanum Srinivas2014-10-061-1/+1
| | | | | | | | | | oslo.utils library now provides the functionality previously in oslo-incubator's excutils, importutils, network_utils, strutils timeutils, units etc. Some modules already moved to oslo.utils will still be around since other code in nova/openstack/common/ are using it and will be removed in a subsequent commit. Change-Id: Idc716342535fdfa680963e0e073ddb46f5f1eb34
* support TRACE_FAILONLY env variableSean Dague2014-10-012-16/+25
| | | | | | | | | | | | | In order to get similar behavior to the way testr out of the box works, only displaying failing results, all the user to define TRACE_FAILONLY environment variable (any value will do). After this point only failures, and things leaking out of stderr will end up on the screen. We also need to remove the suppression of the inline fail dumps for this to have the impact that you'd expect. Change-Id: I72911adc8a03450522429c52db661ec0a1bc4678
* bring over pretty_tox.sh from tempestSean Dague2014-09-162-0/+301
| | | | | | | | | | | | | | Tempest developed a set of wrappers around testr to print out tests as they are running through using the subunit stream. This also displays which workers the various tests are running on. Adapted for nova's need for loading the locking. I expect that the needs of nova will diverge this over time, especially what's displayed during tracing, as such I think it's fine to just do a transplant and not try to turn this into some external repo. Change-Id: Ied1708515fc49f4e18cd8dbb7b2cd821f85e1966
* Fix config generator to use keystonemiddlewareBrant Knudson2014-09-071-1/+1
| | | | | | | | | The auth_token middleware was moved from keystoneclient.middleware to keystonemiddleware. The config generator is configured to point to the new location. Closes-Bug: #1366594 Change-Id: I5543973b2c7ac06c048686c24354ecf6eb251027
* Use oslo.i18nDavanum Srinivas2014-07-182-2/+2
| | | | | | | | oslo.i18n provides the i18n functions that were provided by oslo-incubator's gettextutils module. Some tests that were using internal details of the library were removed. Change-Id: I44cfd5552e0dd86af21073419d31622f5fdb28e0
* Merge "Specify DB URL on command-line for schema_diff.py"Jenkins2014-07-141-31/+40
|\
| * Specify DB URL on command-line for schema_diff.pyRick Harris2013-11-011-31/+40
| | | | | | | | | | | | | | | | | | | | | | The exising schema_diff code had the DB URL format hard-coded which made it difficult to work with since different environments with have different user/password configurations. A more flexible way to handle this, is to have the DB URL specified directly on the command-line. Change-Id: I313bb616e439072e007c886a7f131efc6a61f6df
* | Re-work how debugger CLI opts are registeredMark McLoughlin2014-03-251-5/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | CLI options must be registered before the command line is parsed or a cfg.ArgsAlreadyParsedError is raised. Since commit 2cbea24 we are registering two 'remote_debug' arguments in nova.service. In commit b506529, we see a hack being added to ensure that nova.service is imported and the CLI opts registered before config.parse_args() is called. To clean this up somewhat, refactor all the elements of this remote debugger support into nova.debugger. Avoid importing modules at module import time since we need to import this before monkey patching. Add a function for registering the CLI options just before config.parse_args() is called. And fail gracefully if the CLI options aren't registered when we called debugger.init(). Note that because the options aren't registered at module import time any more, the config generator doesn't pick them up. However, that's actually a good thing since this support doesn't work if you enable it via config files since debugger.enabled() only looks at the command line. DocImpact: remote_debug options are not available via the config file, only via the command line. Change-Id: I97f747a2fb9222137203657df1d86ba89f3219e2
* | VMware: add a file to help config the firewall for vncTracy Jones2014-03-191-0/+4
| | | | | | | | | | | | | | | | | | | | This file can be installed to properly configure the firewall to allow VNC access to openstack instances DocImpact Closes Bug: 1294411 Change-Id: Ifc9a7d88c71dfe1b66d6ac395d9574cc619c1d3a
* | Fix break in vm_vdi_cleaner after oslo changes.Philip Schwartz2014-02-141-1/+7
| | | | | | | | | | | | | | | | | | | | Added missing imports along with adding a call to config.parser_args as needed to allow vm_vdi_cleaner to work against current master. Corrected spelling error in comment. Change-Id: I4d30d0f7f9718cb29fb8c4c18e9e6fa23f3496ef Closes-Bug: #1279942
* | Remove vi modelinesliu-sheng2014-02-039-18/+0
| | | | | | | | | | | | | | | | | | | | We don't need to have the vi modelines in each source file, it can be set in a user's vimrc if required. Also a check is added to hacking to detect if they are re-added. Change-Id: I347307a5145b2760c69085b6ca850d6a9137ffc6 Closes-Bug: #1229324
* | Port to oslo.messagingMark McLoughlin2014-02-011-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The oslo.messaging library takes the existing RPC code from oslo and wraps it in a sane API with well defined semantics around which we can make a commitment to retain compatibility in future. The patch is large, but the changes can be summarized as: * oslo.messaging>=1.3.0a4 is required; a proper 1.3.0 release will be pushed before the icehouse release candidates. * The new rpc module has init() and cleanup() methods which manage the global oslo.messaging transport state. The TRANSPORT and NOTIFIER globals are conceptually similar to the current RPCIMPL global, except we're free to create and use alternate Transport objects in e.g. the cells code. * The rpc.get_{client,server,notifier}() methods are just helpers which wrap the global messaging state, specifiy serializers and specify the use of the eventlet executor. * In oslo.messaging, a request context is expected to be a dict so we add a RequestContextSerializer which can serialize to and from dicts using RequestContext.{to,from}_dict() * The allowed_rpc_exception_modules configuration option is replaced by an allowed_remote_exmods get_transport() parameter. This is not something that users ever need to configure, but it is something each project using oslo.messaging needs to be able to customize. * The nova.rpcclient module is removed; it was only a helper class to allow us split a lot of the more tedious changes out of this patch. * Finalizing the port from RpcProxy to RPCClient is straightforward. We put the default topic, version and namespace into a Target and contstruct the client using that. * Porting endpoint classes (like ComputeManager) just involves setting a target attribute on the class. * The @client_exceptions() decorator has been renamed to @expected_exceptions since it's used on the server side to designate exceptions we expect the decorated method to raise. * We maintain a global NOTIFIER object and create specializations of it with specific publisher IDs in order to avoid notification driver loading overhead. * rpc.py contains transport aliases for backwards compatibility purposes. setup.cfg also contains notification driver aliases for backwards compat. * The messaging options are moved about in nova.conf.sample because the options are advertised via a oslo.config.opts entry point and picked up by the generator. * We use messaging.ConfFixture in tests to override oslo.messaging config options, rather than making assumptions about the options registered by the library. The porting of cells code is particularly tricky: * messaging.TransportURL parse() and str() replaces the [un]parse_transport_url() methods. Note the complication that an oslo.messaging transport URL can actually have multiple hosts in order to support message broker clustering. Also the complication of transport aliases in rpc.get_transport_url(). * proxy_rpc_to_manager() is fairly nasty. Right now, we're proxying the on-the-wire message format over this call, but you can't supply such messages to oslo.messaging's cast()/call() methods. Rather than change the inter-cell RPC API to suit oslo.messaging, we instead just unpack the topic, server, method and args from the message on the remote side. cells_api.RPCClientCellsProxy is a mock RPCClient implementation which allows us to wrap up a RPC in the message format currently used for inter-cell RPCs. * Similarly, proxy_rpc_to_manager uses the on-the-wire format for exception serialization, but this format is an implementation detail of oslo.messaging's transport drivers. So, we need to duplicate the exception serialization code in cells.messaging. We may find a way to reconcile this in future - for example a ExceptionSerializer class might work, but with the current format it might be difficult for the deserializer to generically detect a serialized exception. * CellsRPCDriver.start_servers() and InterCellRPCAPI._get_client() need close review, but they're pretty straightforward ports of code to listen on some specialized topics and connect to a remote cell using its transport URL. blueprint: oslo-messaging Change-Id: Ib613e6300f2c215be90f924afbd223a3da053a69
* | Sync latest config file generator from oslo-incubatorMark McLoughlin2014-01-313-14/+50
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Commits included: e3dddd7 generator: use EXTRA_* env vars in the bash script e8e636c generator: add an EXTRA_LIBRARIES env variable 6da13e8 generator: rename EXTRA_MODULES_FILE to RC_FILE 5dce17b Use entry points to discover options in libraries dd9aa2b Remove unused variables ad17a69 Fix filter() usage due to python 3 compability 343686b Add check_uptodate to tools/config The library option discovery support is the main addition we're interested in since it is required for oslo.messaging. Change-Id: I68958ddd1c1d0c02b54002c36b97270efaaaa892
* | Sync config generator from oslo-incubatorLianhao Lu2014-01-063-37/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Sync from oslo-incubator with the following patches about the config generator: 7c18261 Temporary workaround for config generator 4b3e32b Sort the output of config/generator.py by group name 806272e Improve error reporting on import failures 6cd1c33 Clean up extra modules code 3d077a3 Print the deprecated group/name for each option aec6d94 config.generator: allow extra modules importing ddc4f0d Fix error when no custom config file matches *.conf.sample d4bf84d Allow generate_sample MODULEPATH to be set in env UpgradeImpact DocImpact, the default values in keystone_authtoken config group are changed. Change-Id: If7181e14db2e43e42255bb6221d0543c13c4e5a6
* | Remove unused importWu Wenxiang2014-01-011-1/+0
| | | | | | | | | | | | | | Remove unused import in tools/xenserver/destroy_cached_images.py Change-Id: I5907c99ff702ebe0fc52e9e95c1b0443e20c5c6f Closes-Bug: #1265264
* | Merge "Add auth_token settings to nova.conf.sample."Jenkins2013-11-052-0/+38
|\ \ | |/ |/|
| * Add auth_token settings to nova.conf.sample.Dan Prince2013-10-302-0/+38
| | | | | | | | | | | | | | | | | | | | | | Updates our example config file so that it includes configuration settings for the auth_token middleware. Includes the latest generate_sample.sh from Oslo. Related-Bug: #1240753 Change-Id: I393a67f1f005e775928130c9241aa7e25c391ae3
* | Update schema_diff.py to use 'postgresql' URLs.Dan Prince2013-10-291-1/+1
|/ | | | | | | | | | | | | | This gets rid of a SQLAlchemy deprecation warning when using this tool w/ PostgreSQL: The SQLAlchemy PostgreSQL dialect has been renamed from 'postgres' to 'postgresql'. The new URL format is postgresql[+driver]://<user>:<pass>@<host>/<dbname> This appears to have been deprecated in the SQLAlchemy 0.6 series so I think we are Okay to remove it now. Change-Id: If8fdf822ba452b387e9f2f3ec7c9157e4ae932f9
* Remove .pyc files before generating sample conf.Dan Prince2013-10-181-0/+1
| | | | | | | | | | | | Updates the generate_samples.sh script so that we remove .pyc files in the nova source tree before generating the sample file. If you don't run unit tests the .pyc files won't get regenerated. This can cause cryptic errors if you run tests, switch branches, and then try to regenerate your config files if there are module differences, etc. Change-Id: I784a22c1cd7fb2c69ea1d9e02f87bd7da19d76aa
* Merge "Use print function rather than print statement"Jenkins2013-10-155-28/+40
|\
| * Use print function rather than print statementDavid Ripton2013-10-085-28/+40
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This is for Python 3 compatibility, since Python 3 does not support the print statement, only the print function. (Python 2.6 and 2.7 support both, depending on whether a __future__ import is used.) Paths containing "xen" were left alone, because of comments in a couple of the files indicating that the XenServer code needed to be compatible with Python 2.4. Fixes bug 1226943 Change-Id: I23b804a4d99500b4acf81dd19645ab06dfcc9f1c
* | Remove obsolete redhat-eventlet.patchMark McLoughlin2013-10-093-90/+0
|/ | | | | | | | | | | | | | | | See I62ce43a330d7ae94eda4c7498782a655e63747fa for the gorey details on why this exists. As of this fix: https://github.com/eventlet/eventlet/pull/34 which was released in eventlet 0.13, we no longer need the patch. This has now been removed from oslo-incubator, so this is really just syncing that removal. Change-Id: I84267f3c6726cb2e750f615e107c48b12c6ed353
* Merge "Update sample config generator script"Jenkins2013-09-261-9/+23
|\
| * Update sample config generator scriptZhongyue Luo2013-09-211-9/+23
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This patch reverts 13d80020. The help message should be added in oslo-incubator since generate_sample.sh is synced from there also. Resolves bug #1204204 9f2b93b Sample config file generator clean up 33f9f78 Replaces relative path to absolute path in conf file generator c97e17b Refactors if statement in config generator 8b11fda Provide useful defaults for config generator 4c02e0a Unset OS_xx variable before generate configuration Change-Id: I96fcb39c0c620c147fea5c96416e506a758619ce
* | Syncs install_venv_common.py from oslo-incubatorBob Ball2013-09-201-12/+13
|/ | | | | | | | | | | | | Needed to make run_tests.sh identify requirements correctly We need to check requirements.txt and test-requirements.txt in parallel to ensure both are satisfied and we don't upgrade a package beyond requirements.txt's limits when installing dependencies for test-requirements.txt Fixes bug: 1227019 Change-Id: I606f8a1d3eed5c270d5b3c154994d5c3a17b98c8
* Better help for generate configMichael Still2013-09-151-0/+3
| | | | | | | This just adds a sample command line for how to generate the nova.conf.sample because I keep forgetting how to do it. Change-Id: Id8bfb859f90d7fde51dd1ffdb40ec383ed5193e6
* Updates tools/config/READMEZhongyue Luo2013-08-221-1/+1
| | | | | | | | | The sample command line lacks the arguments required for executing the script. Added the command line used in check_uptodate.sh Fixes bug #1204204 Change-Id: I475491872577632c472695a3b1089caaf1f27d7c
* maint: remove redundant default=None for config optionsPádraig Brady2013-08-091-1/+0
| | | | | | These 73 instances were inconsistent and redundant. Change-Id: I298f2406535d0805caebdca4f2729d720dd5222f
* Merge "xenapi: Fix console rotate script"Jenkins2013-07-271-6/+9
|\
View Lorry Controller Status