summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-126-5/+43
| | | | and KafkaConnection
* Pass consumer timeout to client.poll() in iterator; check timeout before ↵idle_sleepDana Powers2016-01-101-1/+4
| | | | iterating fetcher
* Fix sec / millisec unit bug in KafkaConsumer._poll_once()Dana Powers2016-01-101-1/+1
|
* Receive all available responses in client._pollDana Powers2016-01-101-3/+4
|
* If a completed future is polled, do not blockDana Powers2016-01-101-6/+13
|
* Avoid CPU spinnning when there are no sockets to readDana Powers2016-01-101-0/+8
|
* Fix delayed_task timeout commit 45d26b6Dana Powers2016-01-102-6/+7
|
* Merge pull request #502 from dpkp/task_poll_timeoutDana Powers2016-01-103-13/+19
|\ | | | | Add delayed task timeouts to _poll calls
| * Improve KafkaConsumer iterator loop timeoutstask_poll_timeoutDana Powers2016-01-101-8/+8
| | | | | | | | | | | | - Consider all delayed tasks, not just heartbeat - Include metadata update timeout - Fix second / millisecond bug calling client.poll()
| * Improve cluster.ttl() readabilityDana Powers2016-01-101-3/+7
| |
| * Check delayed task timeout in client.poll()Dana Powers2016-01-101-2/+4
| |
* | Fix debug logging call in PR 500Dana Powers2016-01-101-1/+1
|/
* Remove old kafka.consumer.kafka moduleDana Powers2016-01-101-771/+0
|
* KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-104-74/+53
| | | | out of sync
* Merge pull request #501 from dpkp/coordinator_testsDana Powers2016-01-103-13/+39
|\ | | | | ConsumerCoordinator cleanups and test coverage
| * ConsumerCoordinator cleanupsDana Powers2016-01-102-13/+36
| | | | | | | | | | | | | | | | | | | | | | | | | | | | - default assignors to RoundRobinPartitionAssignor - check offsets types in commit_offsets_* methods - succeed future in _send_offset_commit_request when no offsets - raise exception if no subscribed topics in group_protocols() - fix _subscription typo in metadata listener callbacks - short circuit if no partitions passed to fetch_committed_offsets - line-wrap comments - return future from commit_offsets_async - return future value from commit_offsets_sync - fix self._failed_request callback partial args - comment out metrics class for now
| * Add error checking to mark_for_reassignmentDana Powers2016-01-101-0/+3
| |
* | Merge pull request #499 from dpkp/handle_disconnectDana Powers2016-01-101-0/+5
|\ \ | |/ |/| Refresh metadata on failed connection attempts
| * Refresh metadata on failed connection attemptshandle_disconnectDana Powers2016-01-091-0/+5
| |
* | Move ConsumerProtocol definition to kafka.coordinator.protocolDana Powers2016-01-103-35/+44
|/
* Merge branch '0.9'Dana Powers2016-01-0745-1022/+6372
|\ | | | | | | | | | | | | | | Conflicts: kafka/codec.py kafka/version.py test/test_producer.py test/test_producer_integration.py
| * Fix KafkaClient->SimpleClient references0.9Dana Powers2016-01-074-5/+5
| |
| * Add metadata_max_age_ms and retry_backoff_ms options to async clientDana Powers2016-01-071-0/+8
| |
| * Docstring updatesDana Powers2016-01-075-182/+209
| |
| * Reorg kafka importsDana Powers2016-01-071-11/+12
| | | | | | | | | | | | | | - kafka.KafkaClient is new async client - kafka.SimpleClient is old sync client - update copyright / author info - add BrokerConnection; drop KafkaConnection
| * Fix future redefine bug in client.pollDana Powers2016-01-042-3/+4
| |
| * Call errbacks with future.exceptionDana Powers2016-01-031-1/+1
| |
| * Import queue from six.movesDana Powers2016-01-032-8/+3
| |
| * Catch py3 ConnectionErrorsDana Powers2016-01-032-10/+27
| |
| * Message value can be NoneDana Powers2016-01-031-1/+1
| |
| * Override Message __hash__ to use _encode_self and not recalc crcsDana Powers2016-01-031-0/+3
| |
| * Assert Message value and (optional) key are bytesDana Powers2016-01-031-0/+2
| |
| * Add __hash__ method to StructDana Powers2016-01-031-0/+3
| |
| * Switch to new KafkaConsumer in module importsDana Powers2016-01-031-1/+1
| |
| * Add deprecated methods to KafkaConsumer w/ notes on alternativesDana Powers2016-01-031-0/+31
| |
| * Drop unused method from ConsumerCoordinatorDana Powers2016-01-031-5/+0
| |
| * Disable pylint error on __iter__ (next is provided via six.Iterator)Dana Powers2016-01-032-2/+2
| |
| * Keep support for old largest/smallest auto_offset_reset optionsDana Powers2016-01-031-0/+7
| |
| * Return empty dict from KafkaConsumer.poll if no recordsDana Powers2016-01-031-1/+1
| |
| * Support consumer_timeout_ms in new KafkaConsumerDana Powers2016-01-031-2/+17
| |
| * Check for 0.8.2 GroupCoordinator quirk in BrokerConnectionDana Powers2016-01-031-1/+13
| |
| * Check api_version in ConsumerCoordinatorDana Powers2016-01-031-32/+94
| | | | | | | | | | | | | | - Full group support in 0.9 - Kafka-storage offsets w/ GroupCoordinator in 0.8.2 - Zookeeper-storage offsets in 0.8.1 - Assign all partitions locally if < 0.9
| * Add api_version config to KafkaConsumer; disable features inline by versionDana Powers2016-01-031-11/+36
| |
| * Add KafkaClient.check_version() to guess broker versionDana Powers2016-01-031-0/+52
| |
| * Fix bug in _initiate_connect preventing reconnect to 'bootstrap'Dana Powers2016-01-031-3/+3
| |
| * Fix timeout bug in BrokerConnection.connect()Dana Powers2016-01-031-8/+9
| |
| * Raise exception in KafkaConsumer on unrecognized kwargsDana Powers2016-01-021-1/+4
| |
| * Batched message methods now return dict of listsDana Powers2016-01-022-4/+4
| |
| * Improve iterator interfaceDana Powers2016-01-022-12/+44
| | | | | | | | | | | | | | | | - Support single message consumption via next(consumer) in py2/py3 - batch message methods (Fetcher.fetched_records / KafkaConsumer.poll) are incompatible with iterators -- message generator state keeps messages internally after they are popped from _records, but before subscription_state is updated.
| * Fixup b6a2ad9: Fail with ConnectionErrors in BrokerConnection.sendDana Powers2016-01-021-2/+3
| |
View Lorry Controller Status