summaryrefslogtreecommitdiff
path: root/scripts
Commit message (Collapse)AuthorAgeFilesLines
* fix py2 compatibilityGiampaolo Rodola2022-10-201-2/+5
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* improve API speed benchmark script #2102Giampaolo Rodola2022-10-201-29/+118
|
* move isort and coverage config into pyproject.tomlGiampaolo Rodola2022-10-181-2/+1
| | | | | | ...since pyproject.toml was introduced in #2040. CC @mayeut Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* remove fix_flake8.py re-introduced by accidentGiampaolo Rodola2022-09-191-185/+0
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* resolve conflictsGiampaolo Rodola2022-09-193-2/+187
|\ | | | | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
| * Fix typosKian-Meng Ang2022-01-273-4/+4
| |
* | Fix AppVeyor CI (#2111)Matthieu Darbois2022-06-051-2/+4
| |
* | add flake8-debugger plugin to detect pdb/set_trace() linesGiampaolo Rodola2022-05-252-5/+9
| |
* | integrate flake8-blind-except pluginGiampaolo Rodola2022-05-251-4/+4
| | | | | | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* | introduce flake8-bugbear code checkerGiampaolo Rodola2022-05-252-2/+2
| | | | | | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* | fix print_announce.pyGiampaolo Rodola2022-05-201-4/+2
| |
* | remove tidelift.py scriptGiampaolo Rodola2022-05-201-43/+0
| |
* | Drop Python 2.6 support (#2099)Hugo van Kemenade2022-04-161-2/+0
| | | | | | Signed-off-by: Hugo van Kemenade <hugovk@users.noreply.github.com>
* | Drop Python 2.6 support (#2039)Matthieu Darbois2022-04-151-1/+1
| | | | | | Signed-off-by: mayeut <mayeut@users.noreply.github.com>
* | use autopep8 to automatically fix (some) flake8 failures; get rid of old ↵Giampaolo Rodola2022-04-061-185/+0
|/ | | | | | handmade script Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* assert scripts have +x bitGiampaolo Rodola2021-12-152-7/+8
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* git pre commit hook: use shlex.split()Giampaolo Rodola2021-12-151-6/+4
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* Automatically sort imports (isort CLI tool) (#2033)Giampaolo Rodola2021-12-1430-20/+70
|
* Fix CI tests / wheels / workflow (#2024)Giampaolo Rodola2021-11-292-2/+2
| | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* top.py: report mem usage in GBGiampaolo Rodola2021-09-101-4/+6
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* change tidelift logoGiampaolo Rodola2021-06-061-1/+1
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* improve github actionsGiampaolo Rodola2020-12-192-289/+12
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* add issue/PR botGiampaolo Rodola2020-12-171-0/+286
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* [Windows] #1877: turn OpenProcess -> ERROR_SUCCESS into AD or NSP (#1887)Giampaolo Rodola2020-12-141-3/+4
| | | | Signed-off-by: Giampaolo Rodola <g.rodola@gmail.com>
* refactor wheels download scriptsGiampaolo Rodola2020-11-152-19/+11
|
* Remove Travis and Cirrus, use GH also for FreeBSD (#1880)Giampaolo Rodola2020-11-154-54/+61
|
* Rewrite Linux prlimit() with ctypes (Linux wheels) (#1879)Giampaolo Rodola2020-11-157-8/+75
|
* Fix py 3.9 [WinError 998] Invalid access to memory location (#1866)Giampaolo Rodola2020-10-313-5/+29
|
* disk_partitions() maxfile and maxpath (#1863)Giampaolo Rodola2020-10-241-1/+1
|
* script to convert README for PYPIGiampaolo Rodola2020-10-241-0/+50
|
* [FreeBSD] process resource limits (#1859) (#809)Giampaolo Rodola2020-10-231-1/+4
|
* fix #1855 docGiampaolo Rodola2020-10-191-9/+17
|
* don't use fstringsGiampaolo Rodola2020-10-171-12/+11
|
* mergeGiampaolo Rodola2020-10-171-0/+154
|\
| * pypi download stats scriptGiampaolo Rodola2020-10-1724-260/+435
| |
* | use python 3 as example in docstringsGiampaolo Rodola2020-10-0815-15/+15
| |
* | refactor scripts using cursesGiampaolo Rodola2020-10-083-65/+117
| |
* | update personal site URLGiampaolo Rodola2020-06-161-1/+1
| |
* | Wheels6 (#1767)Giampaolo Rodola2020-05-254-179/+148
|/
* Wheels 3 (#1764)Giampaolo Rodola2020-05-231-8/+6
|
* Wheels2 (#1761)Giampaolo Rodola2020-05-182-1/+155
|
* rename memleaks scriptGiampaolo Rodola2020-05-131-1/+1
|
* Memory leak test: take fluctuations into account (#1757)Giampaolo Rodola2020-05-131-1/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Preamble ======= We have a [memory leak test suite](https://github.com/giampaolo/psutil/blob/e1ea2bccf8aea404dca0f79398f36f37217c45f6/psutil/tests/__init__.py#L897), which calls a function many times and fails if the process memory increased. We do this in order to detect missing `free()` or `Py_DECREF` calls in the C modules. When we do, then we have a memory leak. The problem ========== A problem we've been having for probably over 10 years, is the false positives. That's because the memory fluctuates. Sometimes it may increase (or even decrease!) due to how the OS handles memory, the Python's garbage collector, the fact that RSS is an approximation and who knows what else. So thus far we tried to compensate that by using the following logic: - warmup (call fun 10 times) - call the function many times (1000) - if memory increased before/after calling function 1000 times, then keep calling it for another 3 secs - if it still increased at all (> 0) then fail This logic didn't really solve the problem, as we still had occasional false positives, especially lately on FreeBSD. The solution ========= This PR changes the internal algorithm so that in case of failure (mem > 0 after calling fun() N times) we retry the test for up to 5 times, increasing N (repetitions) each time, so we consider it a failure only if the memory **keeps increasing** between runs. So for instance, here's a legitimate failure: ``` psutil.tests.test_memory_leaks.TestModuleFunctionsLeaks.test_disk_partitions ... Run #1: extra-mem=696.0K, per-call=3.5K, calls=200 Run #2: extra-mem=1.4M, per-call=3.5K, calls=400 Run #3: extra-mem=2.1M, per-call=3.5K, calls=600 Run #4: extra-mem=2.7M, per-call=3.5K, calls=800 Run #5: extra-mem=3.4M, per-call=3.5K, calls=1000 FAIL ``` If, on the other hand, the memory increased on one run (say 200 calls) but decreased on the next run (say 400 calls), then it clearly means it's a false positive, because memory consumption may be > 0 on second run, but if it's lower than the previous run with less repetitions, then it cannot possibly represent a leak (just a fluctuation): ``` psutil.tests.test_memory_leaks.TestModuleFunctionsLeaks.test_net_connections ... Run #1: extra-mem=568.0K, per-call=2.8K, calls=200 Run #2: extra-mem=24.0K, per-call=61.4B, calls=400 OK ``` Note about mallinfo() ================ Aka #1275. `mallinfo()` on Linux is supposed to provide memory metrics about how many bytes gets allocated on the heap by `malloc()`, so it's supposed to be way more precise than RSS and also [USS](http://grodola.blogspot.com/2016/02/psutil-4-real-process-memory-and-environ.html). In another branch were I exposed it, I verified that fluctuations still occur even when using `mallinfo()` though, despite less often. So that means even `mallinfo()` would not grant 100% stability.
* Add new TestFdsLeak test class (#1752)Giampaolo Rodola2020-05-062-0/+8
|
* fix some memleak tests on winGiampaolo Rodola2020-05-051-2/+2
|
* Drastically improve "make test/build" speed.Giampaolo Rodola2020-05-012-15/+15
| | | | | | | Doing "make install" before any test is slow and not really necessary. Instead do "make build", and remove the part import setuptools and test psutil can be imported (do that in make install instead). This way I went down from 0.8 secs (install phase before starting the test) to 0.3 secs!
* Per-test file cleanup and new PsutilTestCase (#1743)Giampaolo Rodola2020-04-301-8/+5
| | | | | Test files/dirs are now removed after each test. when invoked via self.get_testfn(). Until now test files were stored in a global variable and were removed at process exit, via atexit.register(), but this didn't work with parallel tests because the fork()ed workers use os._exit(0), preventing cleanup functions to run. All test classes now inherit from PsutilTestCase class, which provides the most important methods requiring an automatic cleanup (get_test_subprocess() and others).
* Parallel build (#1741)Giampaolo Rodola2020-04-301-5/+6
|
* MemoryLeakTest class enhancements (#1731)Giampaolo Rodola2020-04-232-2/+0
|
* Git hook for renamed/added/deleted files + flake8 print() + tidelift (#1704)Giampaolo Rodola2020-02-215-136/+190
|
View Lorry Controller Status