summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * Add warnings to README, docstring, and logging that async producer does not ↵Dana Powers2014-08-262-1/+9
| | | | | | | | retry failed messages
| * Improve leader failover tests; note that async produce failover is broken -- ↵Dana Powers2014-08-261-45/+67
| | | | | | | | so skip that test for now
* | Add link to kafka-clients google-group on READMEDana Powers2014-08-261-1/+4
| |
* | Merge pull request #136 from DataDog/fix-multifetch-buffer-sizeDana Powers2014-08-261-12/+14
|\ \ | | | | | | | | | | | | | | | | | | fix consumer retry logic (fixes #135) Conflicts: kafka/consumer.py
| * | fix consumer retry logic (fixes #135)Carlo Cabanilla2014-02-281-12/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes bug in the follow condition: * Starting buffer size is 1024, max buffer size is 2048, both set on an instance level * Fetch from p0, p1 and received response * p0 has more than 1024 bytes, consumer doubles buffer size to 2048 and marks p0 for retry * p1 has more than 1024 bytes, consumer tries to double buffer size, but sees that it's at the max and raises ConsumerFetchSizeTooSmall The fix changes the logic to the following: * Starting buffer size is 1024 set on a per-partition level, max buffer size is 2048 set on an instance level * Fetch from p0, p1 and received response * p0 has more than 1024 bytes, consumer doubles buffer size to 2048 for p0 and marks p0 for retry * p1 has more than 1024 bytes, consumer double buffer size to 2048 for p1 and marks p1 for retry * Consumer sees that there's partitions to retry, repeats parsing loop * p0 sent all the bytes this time, consumer yields these messages * p1 sent all the bytes this time, consumer yields these messages
* | | Add a test for Issue #135 (Spurious ConsumerFetchSizeTooSmall error)Dana Powers2014-08-261-0/+19
| |/ |/|
* | Merge pull request #208 from dpkp/add_pylint_to_tox_iniDana Powers2014-08-2610-58/+54
|\ \ | | | | | | Use PyLint for static error checking
| * | Add pylint to tox.ini; test both kafka and test; default to error-checking ↵Dana Powers2014-08-2510-58/+54
| | | | | | | | | | | | only; fixup errors; skip kafka/queue.py
* | | Merge pull request #211 from dpkp/str_only_produce_msgsDana Powers2014-08-263-0/+59
|\ \ \ | | | | | | | | Strictly enforce str message type in producer.send_messages
| * | | Add producer unit test (test/test_producer.py); check supported types in ↵Dana Powers2014-08-261-0/+31
| | | | | | | | | | | | | | | | send_messages
| * | | Raise TypeError in kafka.producer.send_messages if any msg is not a str (or ↵Dana Powers2014-08-262-0/+28
|/ / / | | | | | | | | | subclass); document
* | | Add test timers via nose-timer plugin; list the 10 slowest by defaultDana Powers2014-08-261-1/+2
| | |
* | | Merge pull request #177 from zever/fetch-last-known-offsetsDana Powers2014-08-251-10/+17
|\ \ \ | |/ / |/| | Move fetching last known offset logic to a stand alone function.
| * | also reset `self.fetch_offsets` in `fetch_last_known_offsets`Zack Dever2014-08-251-0/+1
| | |
| * | Move fetching last known offset logic to a stand alone function.Zack Dever2014-08-251-10/+16
|/ / | | | | | | | | | | | | | | | | | | The `Consumer` class fetches the last known offsets in `__init__` if `auto_commit` is enabled, but it would be nice to expose this behavior for consumers that aren't using auto_commit. This doesn't change existing behavior, just exposes the ability to easily fetch and set the last known offsets. Once #162 or something similar lands this may no longer be necessary, but it looks like that might take a while to make it through.
* | Merge pull request #196 from dpkp/reinit_connection_errorDana Powers2014-08-222-40/+177
|\ \ | | | | | | Improve KafkaConnection with more tests
| * | Add a mock to sock.recv() in the test_conn setUp method. Returns 2 packet ↵Dana Powers2014-08-191-61/+25
| | | | | | | | | | | | payloads, then '', then error
| * | Fix test_conn tests wrt _dirty / _sockDana Powers2014-08-191-9/+4
| | |
| * | Improve docstrings in kafka.connDana Powers2014-08-191-4/+14
| | |
| * | Shutdown socket before closing in kafka.connDana Powers2014-08-191-0/+9
| | |
| * | Remove duplicate error handling blocks by moving empty response check into ↵Dana Powers2014-08-191-4/+8
| | | | | | | | | | | | try block in conn.recv
| * | Remove self._dirty and check self._sock instead in kafka.connDana Powers2014-08-191-6/+11
| | |
| * | Remove unused imports from test/test_conn.pyDana Powers2014-08-191-2/+0
| | |
| * | Implement last of the skipped test_conn.py testsDana Powers2014-08-191-2/+18
| | |
| * | Implement a few more skipped tests in test/test_conn.pyDana Powers2014-08-191-4/+19
| | |
| * | Move common connection testing code to setUp methodDana Powers2014-08-191-98/+45
| | |
| * | Implementing more skipped connection tests (send and recv)Dana Powers2014-08-191-6/+82
| | |
| * | Cleanup some connection tests in test/test_conn.pyDana Powers2014-08-191-14/+11
| | |
| * | socket.sendall should always raise an exception on error; remove extra ↵Dana Powers2014-08-191-6/+7
| | | | | | | | | | | | return val check in KafkaConnection.send()
| * | Improve KafkaConnection testing: mock socket.create_connection; add tests ↵Dana Powers2014-08-191-8/+95
| | | | | | | | | | | | for __init__ and send
| * | Add some more debug logging to KafkaConnectionDana Powers2014-08-191-0/+7
| | |
| * | Initialized _dirty in KafkaConnection __init__() and set _sock to None in ↵Dana Powers2014-08-171-2/+4
| | | | | | | | | | | | close()
| * | Call _raise_connection_error in KafkaConnection.reinit() if socket ↵Dana Powers2014-08-171-2/+6
| | | | | | | | | | | | connection fails
* | | Merge pull request #204 from mdaniel/better-type-errorsDana Powers2014-08-223-15/+39
|\ \ \ | | | | | | | | Better type errors
| * | | Fix write_int and write_short type validationMatthew L Daniel2014-08-221-0/+6
| | | | | | | | | | | | | | | | It will still die, just as before, but it now includes a *helpful* error message
| * | | PEP8 fixesMatthew L Daniel2014-08-221-1/+2
| | | |
| * | | Failing test for write_int and write_shortMatthew L Daniel2014-08-221-0/+16
| | | |
| * | | PEP8 fixesMatthew L Daniel2014-08-221-12/+11
| | | |
| * | | Correctly declare unittest2 dependencyMatthew L Daniel2014-08-221-2/+4
| | | |
* | | | Merge pull request #194 from dpkp/kafka_timeout_errorDana Powers2014-08-223-3/+18
|\ \ \ \ | | | | | | | | | | Add KafkaTimeoutError and fix client.ensure_topic_exists
| * | | | Add KafkaTimeoutError (used by client.ensure_topic_exists) and add a testDana Powers2014-08-143-3/+18
| | | | |
* | | | | Add TravisCI config for auto deploymentDavid Arthur2014-08-224-9/+24
| |/ / / |/| | | | | | | | | | | Tags applied to master will now be automatically deployed on PyPI
* | | | Change TravisCI badge to reflect master branchDavid Arthur2014-08-211-1/+1
| | | |
* | | | Tell Travis to build release-* branches as well as masterDavid Arthur2014-08-211-0/+5
| | | |
* | | | Adding IRC to READMEDavid Arthur2014-08-211-1/+3
| |/ / |/| |
* | | Add apt-get install libsnappy-dev instructions to READMEDana Powers2014-08-141-6/+13
|/ /
* | Merge pull request #193 from dpkp/test_apache_binary_releaseMark Roberts2014-08-1418-62/+475
|\ \ | | | | | | Use Kafka Binaries for Integration Tests (Issue #176)
| * | Support integration testing against kafka source builds (see README)vagrant2014-08-135-12/+217
| | |
| * | Increase fixture wait timeout to 30s; add wait-time loggingDana Powers2014-08-131-2/+4
| | |
| * | Update tox.ini to use {posargs} to configure nosetests.Dana Powers2014-08-133-1/+8
| | | | | | | | | | | | | | | | | | | | | | | | To override defaults, use `tox -- --your --nosetest --options --here` Update default nosetest settings to use verbose logging and show test ids add .coverage and .noseids to .gitignore Add example for running single unit test to README