summaryrefslogtreecommitdiff
path: root/kafka/producer
Commit message (Collapse)AuthorAgeFilesLines
...
* Use weakref when registering a producer.close atexit to fix normal gc (#728)Dana Powers2016-06-181-3/+37
| | | | * Use weakref when registering a producer.close atexit to fix normal gc * Test that del(producer) terminates async thread
* KAFKA-3388: Fix expiration of batches sitting in the accumulator (#699)Dana Powers2016-05-221-7/+39
|
* KAFKA-3197: when max.in.flight.request.per.connection = 1, attempt to ↵Dana Powers2016-05-223-11/+33
| | | | guarantee ordering (#698)
* Dont use soon-to-be-reserved keyword await as function name ↵Dana Powers2016-05-222-3/+3
| | | | (FutureProduceResult) (#697)
* Use standard LZ4 framing for v1 messages / kafka 0.10 (#695)Dana Powers2016-05-221-1/+8
| | | | | | * LZ4 framing fixed in 0.10 / message v1 -- retain broken lz4 code for compatibility * lz4f does not support easy incremental decompression - raise RuntimeError * Update lz4 codec tests
* Use Fetch/Produce API v2 for brokers >= 0.10 (uses message format v1) (#694)Dana Powers2016-05-222-4/+15
|
* KAFKA-3025: Message v1 -- add timetamp and use relative offset in compressed ↵Dana Powers2016-05-225-29/+51
| | | | messagesets
* Add CRL support to SSL support (#683)Vincent Bernat2016-05-191-0/+6
| | | | A user can provide a CRL whose peer certificate will be checked against. This only works with Python 3.4+ and Python 2.7.9+.
* Add protocol support for ApiVersionRequest; identify 0.10 brokers in ↵check_version_0_10Dana Powers2016-05-021-1/+1
| | | | check_version
* Add SSL configuration kwargs to KafkaClient, KafkaConsumer, KafkaProducerDana Powers2016-04-091-0/+21
|
* KAFKA-2136: support Fetch and Produce v1 (throttle_time_ms)kafka-2136Dana Powers2016-04-061-3/+5
|
* Use version-indexed lists for request/response protocol structsprotocol_versionsDana Powers2016-04-051-3/+1
|
* Remove unused importskafka-3318Dana Powers2016-04-053-6/+1
|
* KAFKA-3013: Include topic-partition in exception for expired batchesDana Powers2016-04-051-1/+4
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-056-14/+12
|
* Update max.block.ms docstringDana Powers2016-04-041-3/+5
|
* remove unused import. needed a change to kick travis.Zack Dever2016-03-141-1/+0
|
* make Sender._topics_to_add a set instead of a listZack Dever2016-03-141-3/+4
|
* only make a metadata event if we don't know the partitionsZack Dever2016-03-141-1/+4
|
* Fix producer threading bug that could crash sender (dict changing during ↵accumulator_bugfixDana Powers2016-03-141-2/+4
| | | | iteration)
* Always truncate deallocated produce message bufferstruncate_bufferDana Powers2016-03-131-12/+5
|
* Add ignore_leadernotavailable kwarg to SimpleClient.load_metadata_for_topicsDana Powers2016-03-131-1/+1
|
* Add optional timeout parameter to KafkaProducer.flush()Dana Powers2016-03-132-9/+13
|
* Fix for FutureProduceResult.await on python2.6Dana Powers2016-03-131-1/+2
|
* Update base.pyTom Most2016-02-261-1/+1
| | | | | | | | | Our app uses `SimpleProducer` and logs lots of these warnings (from line 438): producer.stop() called, but producer is not async This destructor appears to be the cause. (Also, is it wise to do a thread join from a destructor?)
* Catch duplicate batch.done() calls -- this can happen if we maybe_expire ↵Dana Powers2016-02-181-1/+4
| | | | then process a response errback
* Warn if pending batches failed during flushDana Powers2016-02-181-0/+3
|
* Fix concurrency bug in RecordAccumulator.ready()Dana Powers2016-02-181-2/+6
|
* Some attributes may not exist in __del__ if we failed assertionsDana Powers2016-02-181-1/+1
|
* Fix bug in SimpleBufferPool memory condition waiting / timeoutDana Powers2016-02-181-4/+5
|
* Merge pull request #558 from dpkp/batch_size_zeroDana Powers2016-02-182-5/+7
|\ | | | | Support batch_size = 0 in producer buffers
| * Support batch_size = 0 in producer buffersbatch_size_zeroDana Powers2016-02-172-5/+7
| |
* | Dont override system rcvbuf or sndbuf unless user configures explicitlysocket_buffer_size_optionalDana Powers2016-02-171-4/+6
|/
* Cleanup docstring nested indent (acks values)Dana Powers2016-02-151-9/+10
|
* Cleaner event handling in _wait_on_metadataDana Powers2016-02-151-15/+9
|
* Remove unused internal sender lockDana Powers2016-02-152-24/+20
|
* Revisit _wait_on_metadata to address timeout and error handling (Issue 539)Dana Powers2016-02-151-20/+19
|
* Fixup RequestTimeoutError -> RequestTimedOutErrorDana Powers2016-02-151-1/+1
|
* Add more debug/trace statements to sender loopDana Powers2016-02-021-0/+2
|
* Fix accumulator bug: expired batches should be removed from the internal queueDana Powers2016-02-021-0/+10
|
* Add support for LZ4 compressed messages using python-lz4 moduleDana Powers2016-01-253-4/+5
|
* Add KafkaProducer to kafka and kafka.producer module importsDana Powers2016-01-241-1/+3
|
* Implement new KafkaProducer, mimicing java client interface / designDana Powers2016-01-241-0/+496
|
* Sender class to manage background IO for KafkaProducerDana Powers2016-01-241-0/+272
|
* RecordAccumulator and RecordBatch, for use by async batching KafkaProducerDana Powers2016-01-241-0/+500
|
* Add thread-aware futures for use with KafkaProducerDana Powers2016-01-241-0/+66
|
* Add MessageSetBuffer and SimpleBufferPool to manage producer messagesDana Powers2016-01-241-0/+388
|
* Merge branch '0.9'Dana Powers2016-01-073-43/+51
|\ | | | | | | | | | | | | | | Conflicts: kafka/codec.py kafka/version.py test/test_producer.py test/test_producer_integration.py
| * Docstring updatesDana Powers2016-01-071-18/+35
| |
| * Disable pylint errors for py2/py3 compatibility workaroundsDana Powers2016-01-011-3/+4
| |
View Lorry Controller Status