Search Results: "ag"

11 January 2007

Manoj Srivastava: Mail Filtering with CRM114: Part 2

Or, Cleanliness is next to godliness The last time when I blogged about Spam fighting Mail Filtering With CRM114 Part 1, I left y'all with visions of non-converging learning, various ingenious ways of working around a unclean corpus, and perhaps a sinking feeling that this whole thing was more fragile than it ought to be. During this eriod of flailing around, trying to get mailtrainer to learn the full corpus correctly, I upgraded to an unpackaged version of crm114. Thanks to the excellent packaging effort by the maintianers, this was dead easy: get the debian sources using apt-get source crm114, download tghe new tarball from crm114 upstream, cp the debian dir over, and just edit the changelog file to reflect the new version. I am currently running my own, statically linked 20061103-Blame Dalkey.src-1. Cleaning the corpus made a major difference to the quality of discrimination. As mentioned earlier, I examined every mail that was initially incorrectly classified during learning. Now, there are two ways this can happen: That the piece of mail was correctly placed in the corpus, but had a feature that was different from those learned before; or that it was wrongly classified by me. When I started the chances were almost equally likely; I have now hopefully eliminated most of the misclassifications. When mailtrainer goes into cycles, retraining on a couple of emails round after round, you almost certainly are trying to train in conflicting ways. Cyclic retraining is almost always a human's error in classification. Some of the errors discovered were not just misclassifications: some where things that were inappropriate mail, but not Spam; for instance there was the whole conversation where someone one subscribed debian-devel to another mailing list, there was the challenge, the subscription notice, the un-subscription, challenge, and notice -- all of which were inappropriate, and interrupted the flow, and contributed to the noise -- but were not really Spam. I had, in a fit of pique, labelled them as Spam; but they were really like any other mailing list subscription conversations, which I certainly want to see for my subscriptions. crm114 did register the conversations as Spam and non-Spam, as requested, but that increased the similarity between Spam and non-Spam features -- and probably decreased the accuracy. I've since decided to train only on Spam, not on inappropriate mails; and let Gnus keep inappropriate mails from my eyes. I've also waffled over time about whether or not to treat newsletters from Dr. Dobbs Journal or USENIX as Spam or not -- now my rule of thumb is that since I signed up for them at some point, they are not Spam -- though I don't feel guilty about letting mailagent squirrel them away mostly out of sight. A few tips about using mailtrainer:

Brett Parker: The Apple iPhone: Good thing or not?

So, the Apple iPhone has been launched, it was brought to my attention as actually being announced by the MD at work, who appears to have become a complete apple freak (poor bastard... or is that rich bastard to be able to afford apple's mediocre offerings and be happy about it?). Anyways - from reading the story from BBC News and the official website, here's my conclusions. First off, when marketing a phone, how about you actually mention it's phone capabilities as the number one priority? I'd like to know about the sound capabilities, the battery life, the overall user feel for it as a phone... maybe I'm odd, but a phone has a purpose, it should make and receive calls, and it should do that job *well*, with good quality voice, a decent (filtering) microphone (it's a mobile, you'll be walking whilst speaking on it, reducing the background noise is a selling point), but apple appear to have mostly avoided talking about this. Instead, the first thing that you're told about from the news story is the unique user interface - great, so we have a touchscreen "whoop, de, do!". Worse still, from the official site, the first thing that springs out is that it's a "Wide Screen iPod" - it's a phone, if I wanted an iPod I'd buy a damned iPod - as it stands, for my music needs I have an iAudio M3 which suits my portable music experience really rather well. I choose that on the basis that it provided ogg support out of the box, didn't require any magical software (I run linux on my machines, it presenting itself as nothing more than a USB hard disk was fantastic, and means that I can use it for other things when needs arise). For a phone I want something that actually behaves like a phone, looking at the iPhone it's primary purpose appears to actually be a media player - that's not good. With the iPhone only having a touch screen interface, and from everything that I've read there's no stylus and the "finger is the ultimate pointing device", I'm just expecting that within the first 2 weeks you're going to have a scratched or smudged screen from usage alone, add in the fact that it's a mobile phone, and therefore generally treated with contempt (neccessity rather than luxery), and that most people carry mobiles in their pockets without any form of protection (easy and fast access) and you've got a recipe for disaster! The touch screen is going to be hit (wether you like it or not) whilst the phone is in your pocket, it will wear - there's no question in my mind about it. Touchscreens aren't designed to be smacked around 24/7, they're touchscreens - they respond to touch! So, assuming that you're shiny new iPhone is sitting in your pocket a lot of the time that's a lot of usage of the touchscreen - they're not designed for constant pressure (think about what happens to pockets in trousers when you sit down...), so I don't think that, overall, the sensitivity of the screen is going to last very long. It's only got a fairly narrow screen too, so what about those of us with not entirely slender fingers? When composing SMS messages on it with the on screen qwerty keyboard, do you really think that you're going to get the right keys every time? Small, on screen, buttons and pubs do not mix - and I'd hasten a bet there's a fair number of SMS messages sent from, or on the way back from, the pub, with a predictive text system at least you can almost work out what the heck the person was trying to say - this is a whole new ball game. The iPhone also makes the phone functionality only available after you've hit the part of the screen that says "Phone", now, I don't know about other people, but if I'm being given a number, I tend to just start hitting the right buttons on the phone, I can store the number later (via the call register or whatever) and hit call, now there's an extra step to getting in touch with people. From the official site we have the words """ iPhone also introduces an entirely new user interface based on a large multi-touch display and pioneering new software, letting you control everything with just your fingers. """" - now, err, just when did a phone require you to use anything other than your fingers? Please tell me, I'm dying to know - I've never yet needed to use my feet to operate my phone, have you? This is marketing gone insane - and what worries me is that people actually believe this bullshit. Apple may have "revolutionised" the computer industry with "Mac OS X" (this is actually not something that I believe, and OS X actually makes me more frustrated than being sat infront of a windows desktop - and believe me, that's difficult), but this is a phone, how about they try making it about the phone first, and the next generation tart audio player second? I'm willing to be convinced that I'm wrong, but I definately won't be going out of my way to aquire an iPhone just because the marketing spiel looks good.

10 January 2007

Erich Schubert: Linux distributions to be illegal in Germany?

The biggest party in Bavaria and part of the current german government, CSU, has announced that they want to make the "production and distribution of killer-games" illegal in germany. They claim it's because of a recent highschool shooting (no fatalities except the shooter; there was one other highschool shooting in germany a few years ago with 16 fatalities. Yes, that is 17 fatalities in over 40 years, the 42 years old amok runner back then didn't play killer games, I guess, although he used a flame thrower...). This would make the production and distribution in Germany unlawful, since we include games such as overkill, tremulous and openarena. Other distributions such as SuSE probably include some games that classify as "killer games" as well. Also note that "distribution" is a rather wide term. Does it apply to web sites? ISPs? If there is an online killer game, is the ISP "distributing" it? Polticians (especially those from CSU/CDU/SPD) are such a bunch of idiots. Please do NOT ever again vote for CSU. Software patents, killer games, "Problemfrauen & Schadbären", surveillance cameras and other surveillance, military inside germany (note that in desaster cases such as the flooding some years ago we could already deploy soldats without extra laws), shooting down of civilian airplanes, transrapid, reducing math and natural sciences in highschools, "google earth threatens worldcup security", police installing trojans on home PCs (because criminals don't install virus scanners?), kicking "irritating" students out of school, study fees, ... Often they make George W. Bush look like a genius, don't they? They don't do any important stuff, but just say whatever a majority people might want to hear. They waste our money (Transrapid). They destroy our biggest resource (changes in school system and university system, which will reduce average knowledge in germany a lot). They do lots of stupid things, which heavily invade privacy or public safety (military, surveillance) with no benefits in safety and many of which even where only stopped because they violated our constitution. Do not vote for them! [Updates: Daniel, sorry for posting a non-english post to planet. I again put it into the wrong category; I intended to do a longer post (this one) in english later on. For clarification: CSU is the sister party of CDU, these parties have an arrangement not to compete by region and are closely affiliated. On the nation-wide level they have a joint list, which often is called CDUCSU. So they're not just an "affiliate", but a strong part of the ruling party. Holger Levsen pointed out we are likely going to violate some laws much earlier by distributing ("hacker-") tools such as nmap, ettercap or whireshark.]

Russell Coker: some random Linux tips

Michael Janssen: Steve Jobs sets insane goals..

..or he's not telling us something. If the multi-year exclusive agreement is true, then the goals are probably unachievable. In the keynote yesterday, Jobs put out there that almost a billion phones are sold each year to consumers. Granted, most of these are regular phones without the whiz-bang and special features of the iPhone -- and are usually free to the consumer, subsidized by the contract agreements. Still, he set what most would consider a modest goal, of getting 1% of the cell phone sales - 10 million phones, by the end of 2008.

However, lets do some napkin math. A very small percentage of phones out there today are smart phones. C Net says that 37.4 million smart phones out there. This is probably a pretty conservative estimate by now -- the Gartner study was released in October. Let's give the smart phone people the benefit of the doubt and say that usage triples by the end of 2008. That makes about 100 million smart phones out there. 10 million is ten percent of that market.

Let's look at the math another way. Cingular has 58 million subscribers. Assuming that they gain 20% per year, they will have 68 million at the end of 2008. If Apple is aiming at 10 million phones, that is one out of every seven Cingular customers. Next time you walk down the street, notice count 7 people that you can notice have a phone. If Apple makes its goal, one of those 7 people will own a iPhone, and will have shelled out at least half a grand on it.

These are amazingly high goals for a company that is new in the market. Granted, the iPhone is pretty revolutionary, but I don't think Steve is that crazy. I'm betting that he has something up his sleeve that will help him meet or beat this 10 million goal.

Wouter Verhelst: libgjs

About a year and a half ago (has it been that long already?), I blogged about wanting to write some gobjects. People did give me pointers to some documentation then, but for various reasons I never looked into it in detail afterwards. Since yesterday, though, that's changed. For the last two days, I've been writing on something which I'll eventually release to the world as libgjs:
wouter@country:~/code/c/libgjs/src$ ./gjstest 
There are 1 joysticks on this system
Joystick 0 is a Logitech Inc. WingMan Gamepad Extreme,
	with 10 buttons and 4 axes.
wouter@country:~/code/c/libgjs/src$ 
Wonderful, isn't it? Obviously the above doesn't require the 306 LOC that I've written now (which isn't much, but that's mostly because I had to read a lot of documentation in between); but when finished, the API of that library will be approximately something like this:
if(gjs_joystick_get_max>=0)  
	GjsJoystick *joystick = gjs_joystick_new(0);
	if(joystick->buttons >= 1)  
		g_signal_connect(joystick, "button-pressed",
			start_firing, NULL);
		g_signal_connect(joystick, "button-released",
			stop_firing, NULL);
		g_signal_connect(joystick, "axis-moved",
			move_crosshair, NULL);
	 
	gjs_joystick_set_interval(1);
 
where start_firing, stop_firing and move_crosshair are, obviously, callback functions (they get the button or axis number as a parameter). The set_interval function sets the time between two polls of the kernel device file; this will use the glib mainloop, but it'll also be possible to use a different event loop with gjs_joystick_poll and/or gjs_joystick_poll_all. As of now, it's almost finished; only the signals seem to be something I'm having issues with still. But that's only a matter of not having used gdb enough—I'm sure I'll get there. What gave me the sudden idea to write this library? Something silly, really: for a project I'm currently negotiating, it might be nice if I knew how GObject works; and what better way to find that out than by writing something fun for it? Exactly. Update: Bugs squashed, and the library (along with a small test/demo application) is available. Please try it out and let me know what you think.

Clint Adams: For the sake of raising her technorati rank

Earlier, I linked to some douchebag who discusses the aesthetic judgment of photographers. Now the good doctor links to a photo of which I would be proud, if only I had taken it.

Wouter Verhelst: AAAAAAAAAAAAAARGH!

Lilypond is a great piece of software, but its documentation is sucky as hell. I've been trying to tweak the output of a particular piece of music which turned out to have just one system on the final page using the default settings, so that this final staff would end up on the first page, too. The documentation on how to do this, however, is less than helpful. If there is a mistake that could've been made by the people who wrote the manual, be sure they made it: Really, I would be very happy if the lilypond authors were to just find someone who actually knows how to write decent documentation.

Uwe Hermann: Linux Kernel in a Nutshell - Creative Commons licensed O'Reilly book by Greg Kroah-Hartman

Greg Kroah-Hartman's new book Linux Kernel in a Nutshell is now available in stores, as well as for download on his website. To quote O'Reilly:
Written by a leading developer and maintainer of the Linux kernel, Linux Kernel in a Nutshell is a comprehensive overview of kernel configuration and building, a critical task for Linux users and administrators. No distribution can provide a Linux kernel that meets all users' needs. Computers big and small have special requirements that require reconfiguring and rebuilding the kernel. Whether you are trying to get sound, wireless support, and power management working on a laptop or incorporating enterprise features such as logical volume management on a large server, you can benefit from the insights in this book. Linux Kernel in a Nutshell covers the entire range of kernel tasks, starting with downloading the source and making sure that the kernel is in sync with the versions of the tools you need. In addition to configuration and installation steps, the book offers reference material and discussions of related topics such as control of kernel options at runtime. A key benefit of the book is a chapter on determining exactly what drivers are needed for your hardware. Also included are recipes that list what you need to do to accomplish a wide range of popular tasks.
It's yet another great book licensed under a Creative Commons license. It's good to see that more and more books are now being freely licensed...

Miriam Ruiz: A cute toy

One of the most typical religious traditions in Spain, within the Xmas celebrations, is the Kings’ day (”D a de Reyes”), which is celebrated every year on the 6th of January remembering the arrival of the three Kings to bring their presents to baby Jesus. It is quite typical to have presents that day, and one of the things I got this year was an external 2.5′’ HD case with multimedia playing capacity. I also got a 120 Gb 2.5′’ HD for it. The strongest point I had for it was that my brother already has one and it seems to support many file formats and codecs without problem. In my very short experience with it, just a few days for the moment, it has been able to reproduce all the films I have tried. The main drawback is that it only supports VFAT/FAT32 and NTFS partitions, and only 2 different partitions, no more. Thus, I had to cope with NTFS if I wanted to use the whole HD. I created one VFAT partition as big as supported by that filesystem (32 Gb, with a file limit of 4 Gb) just in case I need it when I go to some friends’ house, and another NTFS partition for the rest of the disk. The next point was to be able to read and write to it from my Debian-powered computer. Reading NTFS is no problem at all, as it seems to be built-in in the kernel by default, but for being able to write on it, I had to use ntfs-3g. It seems to work perfect for me, on an Intel-compatible 32bit computer.

Adrian von Bidder: Shut down: relays.ordb.org

Just a quick alert since it's quite widely used and since I've completely missed the media coverage and only noticed it when logcheck started sending me long emails every hour: relays.ordb.org was shut down, you may need to adjust your mailer's configuration. At least they've not blacklisted the whole Internet (yet.)

Ian Murdock: Best of breed 2.0

Richard MacManus: “Instead of using the entire product suite of a Google or an MSN or a Yahoo, you [should be able to] use the particular apps you like most from not only big players - but small startups too.” I agree wholeheartedly. I’m a big believer in the componentization of the web, as I’ve written about before. Without a way to write independent apps that integrate with each other regardless of where they’re hosted, the future starts to look more and more like the mainframe era (albeit with better graphics). The world needs only five computers (shaping up to be Amazon, Google, Salesforce.com, Windows Live and Yahoo!). However, we need to ensure that these five computers operate more as computing utilities where a thousand flowers can bloom than as centralized monoliths where the only way to integrate is to be assimilated.

Gustavo Franco: What you did for Debian in the past year?

Dear lazyweb,
Looking back, what a insane year, but not due to the Debian related stuff that was fun to do, to say the least. Anyway, i hope to write similar stuff in the next year but with a even more exciting content. Thanks for those that helped me and those who did something for Debian in the past year. See you!

Evan Prodromou: 19 Niv se CCXV

Long-ago San Francisco Cacophony Society leader and early Burning Man organizer John Law is calling for the release of the Burning Man trademark into the public domain. An interesting story and some interesting questions about process. Burning Man is an event and a culture dear to my heart; I wonder how this is going to work out. Thanks to Scott Beale for his story on the subject; he knows the principals much better than I do. tags:

Dear Lazyweb So, I was trying to read some documentation on my little Toshiba Port g and also lie down on the couch and also drink a beer, and these three activities weren't mutually compatible and I spilled some beer on my keyboard (and lap). Doh. I dried it off as best I could, and turned it upside-down like a teepee to dry overnight so the booze and moisture and sugar would go out of the computer instead of further in. Which seems to have paid off: the computer's running fine now. Except that the 'R' and 'G' keys don't work. They're not particularly sticky, they just don't register any key events when pressed. So, my question: what's my next step? Is there some trick I can do? Or am I just going to have to get good at lipograms? Drop me a line at evan@prodromou.name if you have any ideas. tags:

Father-Daughter Night Maj started French classes at the fantastico Montreal YMCA Language School. (I'm taking classes in German at the Montreal Goethe Institute starting next week; we came up with the idea of taking language classes independently.) Since Mama was out of the house from 5PM to 9PM, I got to do most of the evening prep for the night. Which was fun. I made Amita June and myself some ravioli and ros sauce, and we put a bowl in the fridge for Maj, too. Then we watched about 20 minutes of Babe, which had lots of cows and ducks and chickens and stuff she likes watching, but I was too worried that someone was going to get killed and eaten to enjoy watching it with her. So we did a bath -- she figured out how to make her rubber duck squirt water into the air, and that was worth about 20 minutes of giggles right there. Then we read some books, and by that point she was really ready for bed, and fell right asleep. We've been doing really good this week with going to sleep. I mentioned before that she's weaning from night nursing, so I'm doing most of the putting-to-bed and keeping-asleep work around here. It's been fun and rewarding; sleeping babies are great. tags:

Snow! It snowed today in Montreal! Just a little bit, but still. Hooray for us. tags:

Googie I also stumbled across the word Googie architecture this evening. Interesting term and comfort food for the California native's soul. tags:

yulblog Tomorrow night (20 Niv se or 10 January for those of you who still use that oppressive Gregorian calendar) we've got the misnomered First Wednesday Get-Together for yulblog. The date was moved back from the very first Wednesday of the month to the second Wednesday to give some space around New Year's Day. I think the novelty has got people interesting in attending; I've talked to more than one person who's going to go. So, I'm going too. At the Quincaillerie at 980 Rachel, 8PM. tags:

Effin' MyBlogLog So, I signed up for that MyBlogLog a while ago (see Journal/29 Frimaire CCXV), just to see how it worked. But I disconnected it from my own site since I thought the click-tracking was a little invasive. But I must have some cookies still left around, because I keep looking at sites like Read/WriteWeb, which has a nice article about OpenID, and I'm reading along and then there's a picture of me right on the page. Inserted from the MyBlogLog script, but it scares the crap out of me when it happens. Effin' MyBlogLog! tags:

Adam Rosi-Kessel: Language Acquisition

One fascinating experience in parenthood is witnessing language acquisition. My daughter is just over twenty-one months old, and recently hit an asymptote in language development. One of my favorite phenomena probably has a name, although I don’t know what it is. When she wants to be carried, she says, “carry you?” If she wants me to sit next to her while she falls asleep, she says, “sit next to you?” Likewise, “pick you up?” And so on. On the one hand, she’s really getting it. On the other, there still seems to be a missing parsing module. Although I minored in linguistics, we almost never studied anything having to do with “real” language. The department was virtually 100% Chomskyan, and we spent much of our time trying to figure out what the heck the Minimalist Program was. As it turns out, the Minimalist Program did nothing to prepare me for the experience of watching my daughter acquire language.

9 January 2007

Rob Bradford: GNOME power manager strikes again

Now that I have my desk sorted in my new flat i’ve begun to use my wireless mouse again. I was pleasantly surprised to see that gnome-power-manager (through HAL) gave me battery statistics on my mouse. Cute. So in the next major release I expect it to warn me when *my* energy levels are running low and suggest I take in a caffeine fix.
GNOME power manager strikes again!

Steve McIntyre: Weekend in Helsinki

Just spent a long weekend (Thursday night to Monday afternoon) in Finland. Hanna invited me over a while ago with a promise of sauna and ice swimming, and I'm a sucker for travelling to parties these days... *grin*. Unfortunately, the weather in Finland (just like in the UK) at the moment is ridiculously warm for the time of year. When I visited in November for the BSP, there was some snow on the ground and temperatures were as cold as I expected. This time, there was no sign of any snow and I was worried that we might not get any ice...! Lars was kind enough to offer me some crash space at short notice for my visit (there's nothing like last-minute organisation for this kind of jaunt!). On Friday we met up with Jesus, Jeroen, Hanna, Pixie and Dave for lunch and some wandering around in the middle of Helsinki. Then on to some bars later for some drinks and food. I could get used to this... :-) On Saturday, we got up early, bought large amounts of food and drink to take with us, and caught the bus north-west out of Helsinki towards central Finland. 90 minutes on the bus and in a taxi, and we were dropped off at Hanna's family's cottage by the lake below: As we got there, the temperature was dropping just enough that we could actually see the ice forming on the lake. Beautiful! In the middle of nowhere in the forest, things were incredibly quiet and peaceful. We lit the fire for the the sauna, and wandered off for a walk through the forest. Later on, beer, sauna and (almost) ice swimming. Naked geeks! I must admit that I chickened out a little - coming out of the sauna into freezing temperatures slowed me down a little. By the time I reached the bottom of the steps to the lake surface, I couldn't force myself into the lake fully. I got three toes wet, then ran back inside into the warm... :-) Dave was more resilient (in and out FIVE times!), but it looks like he maybe overdid things. He crashed out later and was acting quite oddly for a while - we worked out that he was probably dehydrated. We carried on drinking and snacking at the cottage, then headed back into Helsinki for the bars and clubs later that night. More of the same on Sunday along with a cinema visit, and I was thoroughly exhausted and ready to head back to the UK on Monday. Thanks very much to Hanna, Lars, Jesus and the others for making my trip so much fun. Helsinki is a lovely place to visit, although probably too expensive for me to manage it too often. I'm saving already for the next time! I've put my photos online as usual.

Enrico Zini: bts-utils

A couple of BTS utilities I had the idea of creating a script that would tell me which bug numbers have unanswered mails. The idea is simple: get me all the bug numbers for which the last message posted has not been sent neither by me nor by any of the comaintainers. Firstly, I needed a script that gives the e-mail address of the sender of the last message received for a given bug:
$ mkdir cache
$ ./getlast 370102
enrico@debian.org
Then I needed a srcipt that gives the bug numbers currently in open state for a given source package:
$ ./getopen debtags
246678
277626
290457
[...]
Finally I needed to correlate the information from a maintainer database with the results of the previous scripts:
$ ./show-unanswered enrico@enricozini.org enrico@debian.org
Buffy comaintained by xxxxxxx@debian.org, xxxxxxxxx@xxxxxxxx.xx
  bug #269386 answered by me
  bug #293898 answered by me
  bug #294436 answered by comaintainer xxxxxxx@debian.org
  bug #300444 answered by me
  bug #372513 answered by comaintainer xxxxxxx@debian.org
  bug #383610 answered by comaintainer xxxxxxx@debian.org
  bug #384108 unanswered message from xxxxxxxx@debian.org
  bug #384116 unanswered message from xxxxxxxx@debian.org
[...]
This could make some people happy. You can get it with bzr branch http://people.debian.org/~enrico/bts-utils

Pierre Habouzit: HE ftw !

your work is very much appreciated. C that's an incredible tedious work. Really thank you.

Julien Blache: pommed v1.1 : PowerBook support

I’ve just released pommed v1.1, which adds support for (some) PowerBook laptops. If your laptop is not supported, send us the content of /proc/device-tree/model and we’ll send you a test-tarball. gpomme received some improvements in this release: The original tarball (available on Alioth, pommed project) contains an alternate theme for gpomme, named Tango. It’s not included in the Debian package because the Tango icons from FreeDesktop.org are licensed under CC BY-SA 2.5 which we don’t consider DFSG-free. It’s a nice, clean theme for gpomme which you’ll probably prefer over the default one. Copy it to /usr/share/gpomme/themes and run gpomme -t Tango to use it. If anybody knows where to find the SVG sources for the Crystal icon theme, I’m all ears. Thanks to Eduardo Bellido Bellido for the spanish translation and the multiple head patch for gpomme. Thanks to Daniel G. Siegel for the Tango theme.

Next.

Previous.