Emulating C structs in Python
One of the few data types from C that I miss when writing Python code
structs. The simplest replacement is dictionaries, but that means
you have to write
thing['field'] instead of
thing.field. I can't
stand that (it's the extra characters).
If you want
thing.field syntax in Python, you need an object. The
struct emulation is just to use a blank object and
set fields on it:
class MyStruct: pass ms = MyStruct() ms.foo = 10 ms.bar = "abc"
Some people will say that this is an abuse of objects, since they don't have any code, just data. I say to heck with such people; sometimes all I want is data.
(Avoid the temptation to just use '
ms = object()', because it hurts
your ability to tell different types of structs apart via
Initialization this way is tedious, though. We can do it easier and more compactly by using keyword arguments when we create the object, with a little help from the class. Like so:
class Struct: def __init__(self, **kwargs): for k, v in kwargs.items(): setattr(self, k, v) class MyStruct(Struct): pass ms = MyStruct(foo = 10, bar = "abc")
(And look, now our objects have some code.)
It's possible to write the
__init__ function as
self.__dict__.update(kwargs)', but that is fishing a little
too much into the implementation of objects for me. I would rather
use the explicit setattr loop just to be clear about what's going on.
(I am absolutely sure people have been using this idiom for years before I got here.)
Sidebar: dealing with packed binary data
If you need to deal with packed binary data in Python, you want the struct module.
This is a much better tool than C has, because
structs are not good
for this (contrary to what some people think);
structs do not
actually fully specify the memory layout. C compilers are free to
insert padding to make field access more efficient, which makes
struct memory layout machine and compiler dependent.
(I sometimes find it ironic that supposedly 'high level' languages like Python and Perl have better tools to deal with binary structures than 'low level' C.)
Weekly spam summary on December 17th, 2005
To start with, Hotmail's numbers:
- 3 emails accepted from Hotmail, at least two of them likely spam.
- 263 messages rejected because they came from non-Hotmail email addresses.
- 106 messages sent to our spamtraps.
- 33 messages refused because their sender addresses had already hit our spamtraps.
- 6 messages refused due to their origin IP address (five for being in the SBL, and one from Nigeria).
Despite all of these crappy numbers, we've determined that we get at least some legitimate and wanted email from Hotmail, so we will not be blocking them entirely. Oh well. Dear Hotmail: please fix your spam problems.
On the rest of the numbers:
This week we received 16,179 email messages from 209 different IP addresses. Our SMTP server handled 23,552 sessions from 2,014 different IP addresses. Email volume is slightly down from last week, although session volume is up significantly and the number of sources has doubled.
Connection volume is up significantly from last week: 150,000 connections from at least 42,800 different IP addresses. Again there is a significant jump in the number of different IP addresses trying to talk to us.
Most of the week looks relatively ordinary (although overall higher than last week), but come Friday and we see a significant upturn. I suspect that this trend will continue on through next week.
Kernel level packet filtering top ten:
Host/Mask Packets Bytes 22.214.171.124 6694 402K 126.96.36.199 5600 269K 188.8.131.52 5552 266K 184.108.40.206 5047 242K 220.127.116.11 4860 292K 18.104.22.168/24 3766 187K 22.214.171.124 2620 131K 126.96.36.199 2475 126K 188.8.131.52 2209 106K 184.108.40.206 2108 101K
Apart from Telecom Italia's outgoing mail servers, this is all individual hosts.
- Only 220.127.116.11 returns from before.
- 18.104.22.168 is a fastwebnet.it machine; we don't talk to any of them due to too much spam.
- 22.214.171.124, 126.96.36.199, and 188.8.131.52 are all what we consider 'dialup' machines.
- 184.108.40.206 is on the ORDB.
- 220.127.116.11 is on the CBL.
- 18.104.22.168 and 22.214.171.124 are both lacking in good reverse DNS.
- 126.96.36.199 sent us too many unresolvable
The overall packet counts are up somewhat over last week.
Connection time rejection stats:
29999 total 14435 dynamic IP 8935 bad or no reverse DNS 4243 class bl-cbl 620 class bl-sbl 497 class bl-ordb 326 class bl-sdul 249 class bl-dsbl 222 class bl-spews 54 class bl-njabl 11 class bl-opm
The 'dynamic IP' and CBL numbers have jumped significantly, without having any one single source. It looks like spammers have started up targeting our users with significant spam runs, most of which we have hopefully refused.
|what||# this week||(distinct IPs)||# last week||(distinct IPs)|
I'm not surprised by the sudden jump in both of these numbers, although I'm not thrilled either (especially by the jump in bad bounces, since that means spammers are back to forging us into the origin addresses of their spams).