<feed xmlns='http://www.w3.org/2005/Atom'>
<title>delta/python-packages/kafka-python.git/kafka, branch struct-pre-compilation</title>
<subtitle>github.com: mumrah/kafka-python.git
</subtitle>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/'/>
<entry>
<title>Pre-compile pack/unpack function calls</title>
<updated>2018-10-29T04:44:00+00:00</updated>
<author>
<name>billyevans</name>
<email>pervushinai@gmail.com</email>
</author>
<published>2018-07-20T21:11:41+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=232aed4eca9acfc9fbf468059afabb0bc93f174b'/>
<id>232aed4eca9acfc9fbf468059afabb0bc93f174b</id>
<content type='text'>
I noticed that pack/unpack functions from
https://github.com/dpkp/kafka-python/blob/master/kafka/protocol/types.py
might be slightly improved. I made pre-compilation for them. It gives
about 10% better performance compared to the current implementation.

Consumption of 100msg:
```
239884    0.187    0.000    0.287    0.000 types.py:18(_unpack) # new version
239884    0.192    0.000    0.323    0.000 types.py:17(_unpack)
```

I also made some profiling for producers/consumers. It gives about
1-1.5% time savings.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
I noticed that pack/unpack functions from
https://github.com/dpkp/kafka-python/blob/master/kafka/protocol/types.py
might be slightly improved. I made pre-compilation for them. It gives
about 10% better performance compared to the current implementation.

Consumption of 100msg:
```
239884    0.187    0.000    0.287    0.000 types.py:18(_unpack) # new version
239884    0.192    0.000    0.323    0.000 types.py:17(_unpack)
```

I also made some profiling for producers/consumers. It gives about
1-1.5% time savings.
</pre>
</div>
</content>
</entry>
<entry>
<title>Stop using deprecated log.warn()</title>
<updated>2018-10-27T05:55:52+00:00</updated>
<author>
<name>Jeff Widman</name>
<email>jeff@jeffwidman.com</email>
</author>
<published>2018-10-27T05:53:03+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=8791f0558fc103df43a2d7ab214904ad9a15f147'/>
<id>8791f0558fc103df43a2d7ab214904ad9a15f147</id>
<content type='text'>
I missed this in my previous cleanup back in 9221fcf83528b5c3657e43636cb84c1d18025acd.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
I missed this in my previous cleanup back in 9221fcf83528b5c3657e43636cb84c1d18025acd.
</pre>
</div>
</content>
</entry>
<entry>
<title>Add temp workaround for upstream pylint bug</title>
<updated>2018-10-27T04:03:48+00:00</updated>
<author>
<name>Jeff Widman</name>
<email>jeff@jeffwidman.com</email>
</author>
<published>2018-10-26T21:09:54+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=cd0bd8e4db66a532f19a76908c677ebf004f642e'/>
<id>cd0bd8e4db66a532f19a76908c677ebf004f642e</id>
<content type='text'>
Temporarily workaround https://github.com/PyCQA/pylint/issues/2571 so that we can stop pinning `pylint`.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Temporarily workaround https://github.com/PyCQA/pylint/issues/2571 so that we can stop pinning `pylint`.
</pre>
</div>
</content>
</entry>
<entry>
<title>Add KafkaAdmin class</title>
<updated>2018-10-25T05:42:12+00:00</updated>
<author>
<name>Richard Lee</name>
<email>github@richardlee.name</email>
</author>
<published>2018-07-12T18:39:29+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=481f88068bdf0a18f12fd7a811b795f889d35fc7'/>
<id>481f88068bdf0a18f12fd7a811b795f889d35fc7</id>
<content type='text'>
Requires cluster version &gt; 0.10.0.0, and uses new wire protocol
classes to do many things via broker connection that previously
needed to be done directly in zookeeper.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Requires cluster version &gt; 0.10.0.0, and uses new wire protocol
classes to do many things via broker connection that previously
needed to be done directly in zookeeper.
</pre>
</div>
</content>
</entry>
<entry>
<title>Vendor enum34</title>
<updated>2018-10-22T21:36:20+00:00</updated>
<author>
<name>Jeff Widman</name>
<email>jeff@jeffwidman.com</email>
</author>
<published>2018-10-22T05:55:58+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=a7e28aeacf6579720594bfe9201a8945d2935c3e'/>
<id>a7e28aeacf6579720594bfe9201a8945d2935c3e</id>
<content type='text'>
This is needed for https://github.com/dpkp/kafka-python/pull/1540

While the usage there is trivial and could probably be worked around, I'd
rather vendor it so that future code can use enums... since `enum` is
already available in the python 3 stdlib, this will be easy enough to
eventually stop vendoring whenever we finally drop python 2 support.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This is needed for https://github.com/dpkp/kafka-python/pull/1540

While the usage there is trivial and could probably be worked around, I'd
rather vendor it so that future code can use enums... since `enum` is
already available in the python 3 stdlib, this will be easy enough to
eventually stop vendoring whenever we finally drop python 2 support.
</pre>
</div>
</content>
</entry>
<entry>
<title>Vendor `six` consistently</title>
<updated>2018-10-22T21:30:33+00:00</updated>
<author>
<name>Jeff Widman</name>
<email>jeff@jeffwidman.com</email>
</author>
<published>2018-10-22T08:24:50+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=b83feeca2ec6f6ad745fb7ea47c6484304bb55d8'/>
<id>b83feeca2ec6f6ad745fb7ea47c6484304bb55d8</id>
<content type='text'>
Use vendored `six`, and also `six.moves.range` rather than `xrange`
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Use vendored `six`, and also `six.moves.range` rather than `xrange`
</pre>
</div>
</content>
</entry>
<entry>
<title>Update remote urls: snappy, https, etc</title>
<updated>2018-10-22T21:29:46+00:00</updated>
<author>
<name>Jeff Widman</name>
<email>jeff@jeffwidman.com</email>
</author>
<published>2018-10-22T07:06:16+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=a6be21e7b3a20ce2e25ef26140c43b59cc356f38'/>
<id>a6be21e7b3a20ce2e25ef26140c43b59cc356f38</id>
<content type='text'>
Snappy URL was outdated. Similarly, many of these sites now support
https.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Snappy URL was outdated. Similarly, many of these sites now support
https.
</pre>
</div>
</content>
</entry>
<entry>
<title>Bump vendored `six` to `1.11.0`</title>
<updated>2018-10-22T15:36:37+00:00</updated>
<author>
<name>Jeff Widman</name>
<email>jeff@jeffwidman.com</email>
</author>
<published>2018-10-22T05:36:54+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=477ab740c0c105daef0e8411f95c06ad49f7f782'/>
<id>477ab740c0c105daef0e8411f95c06ad49f7f782</id>
<content type='text'>
Bump `six` to `1.11.0`. Most changes do not affect us, but it's good to
stay up to date. Also, we will likely start vendoring `enum34` in which
case https://github.com/benjaminp/six/pull/178 is needed.

Note that this preserves the `kafka-python` customization from https://github.com/dpkp/kafka-python/pull/979
which has been submitted upstream as https://github.com/benjaminp/six/pull/176 but not yet merged.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Bump `six` to `1.11.0`. Most changes do not affect us, but it's good to
stay up to date. Also, we will likely start vendoring `enum34` in which
case https://github.com/benjaminp/six/pull/178 is needed.

Note that this preserves the `kafka-python` customization from https://github.com/dpkp/kafka-python/pull/979
which has been submitted upstream as https://github.com/benjaminp/six/pull/176 but not yet merged.
</pre>
</div>
</content>
</entry>
<entry>
<title>Support produce with Kafka record headers</title>
<updated>2018-09-27T22:22:03+00:00</updated>
<author>
<name>Heikki Nousiainen</name>
<email>htn@aiven.io</email>
</author>
<published>2018-08-14T12:17:23+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=08c77499a2e8bc79d6788d70ef96d77752ed6325'/>
<id>08c77499a2e8bc79d6788d70ef96d77752ed6325</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Expose record headers in ConsumerRecords</title>
<updated>2018-09-27T22:22:03+00:00</updated>
<author>
<name>Heikki Nousiainen</name>
<email>htn@aiven.io</email>
</author>
<published>2018-08-14T12:38:42+00:00</published>
<link rel='alternate' type='text/html' href='http://git.baserock.org/cgit/delta/python-packages/kafka-python.git/commit/?id=0ca4313170df2657456009af5550942ace9f1a81'/>
<id>0ca4313170df2657456009af5550942ace9f1a81</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
