Search Results: "will"

15 August 2006

Steve Kemp: Dancing with you all the time, and don t you think that it s a crime

A busy night which resulted in a new release of xen-shell, this coincided with me noticing that is being used by a Dutch ISP. (Fun sometimes googling your own name, or the name of software projects!) I’ve added the project to freshmeat, under the obvious name, but no Debian package yet. I will probably make one soon though. After that I fixed many many bugs/feature suggestions reported against xen-tools by Henning Sprang - a name I know a lot from the Xen lists. Assuming I don’t get distracted there will be a new release of that tomorrow. All the tests pass, and the code seems to work so I’m pretty sure it’ll go OK. I’ve noticed though that my release speed is almost inversely proportional to the number of interested users.

Steve McIntyre: DNSBL and SMTP callouts

Russell asks about the interaction between blocking and callouts. If people have configured their mail server to block connections completely using blacklist data, then they're quite simply asking to not get mail. The traditional way to implement these checks is to allow connections, MAIL FROM and RCPT TO. Drop connections at the DATA stage. Normal callout connections will never get that far. Aside: I'd have simply added this as a comment on your blog, but I'd need to set up a blogger.com account (which is a pain) and they currently don't seem to be allowing any of the 20-ish account names I just tried, including random alphanumerics (worse).

Andrew Pollock: [tech] How to mount ATA over Ethernet volumes with a minimum of grossness

Yesterday I discovered some inadequacies in the stock Debian Etch initscripts when it came to filesystems on ATA over Ethernet block devices. Overnight I got a few emails, but it was a one Joshua J. Kugler who brought my attention to the _netdev mount option. The mount(8) manpage really is a treasure-trove of information that should be read often. So, in a nutshell, here's what I'm doing: Finally, I found I had to either load the aoe kernel module as a post-up operation for the Ethernet interface in /etc/network/interfaces or load it in /etc/modules and call /usr/sbin/aoe-discover as a post-up operation in /etc/network/interfaces, because just loading it from /etc/modules resulted in the driver being loaded a fair while before the network came up, and once the network had come up, it took the driver longer than the time for /etc/init.d/mountnfs.sh to be run to realise there were ATA over Ethernet devices on the LAN and arrange for the relevant entries to appear in /dev/etherd. I've currently opted for running aoe-discover from /etc/network/interfaces. So I'm now very happy. I can reboot my MythTV server and everything comes back without any intervention whatsoever. Sweet. It'd be nice if these fixes can make it into Etch, as all of the other components will be there for ATA over Ethernet support. The kernel is new enough to have the driver as standard, and vblade is in Etch. Just the support to mount it all properly isn't there. Oh, and nothing I've done (with the exception of the post-up stuff in /etc/network/interfaces) is ATAoE-specific. It'll work equally well for NBD for example, and presumably other SAN-like stuff. I certainly find this approach far less gross than what Coraid suggests, and it'd also be cool if Debian were the first distro to do it the right way. I wonder if Red Hat/Fedora are already? I suppose I could fire up Xen or VMware and find out if I get curious enough.

Benjamin Seidenberg: All packed

[This is the first post in the new “Cornell” Category]
Well, my room looks quite empty and the van is quite full. We weren’t sure if all the stuff we were planning on taking was going to fit, but it did. Now, the question is will it fit in the 10×10 dorm room that is typical of the building I’m in. We’ll soon find out. We are driving up to Ithaca Thursday, and I move in Friday. Now that it’s getting close, I am starting to get more and more excited.
If anyone recently out of college, or still in it (Ari, joshk, and others) wants to offer any advice for a rising freshman, feel free to leave a comment. In other news (those of you who were helping me in #d-d already know), my server was out of commision for a few days. Grub and lilo both refused to boot off the 200 hard drive that I had moved my data to using a live system, and sarge D-I saw it as the wrong size, and did not see the partitions (perhaps why grub and lilo both failed). This was apparently a kernel issue, and so I installed using the etch beta3 netinst. G-I was working fine, but after partitioning got in a loop where it would drop to console and complain about some fatal error then go back to graphics again (somewhere around setting time zone) so I eventually used the old text system, which worked flawlessly. The only thing that I found I forgot to backup was my wordpress theme directory, so not only do I have to find my theme again (whose name I forget), I have to modify it, since I had customized the CSS. Pity.
The last bit of this post is a thank you to Joerg for approving my NM application. Now all that’s left is for elmo to proccess his backlog.

Evan Prodromou: 27 Thermidor CCXIV

I went up today to visit Kasper Souren, AKA Guaka, who's visiting wt:Montreal for a few weeks. Kasper and I have been in touch for several years -- he's been involved with Wikitravel almost as long as anyone -- but we just met in person a couple of weeks ago at Wikimania. He's just returned from South America, and will soon depart for the West Coast of North America and then off to Mexico. He's quite a traveller. Guaka's here to help out with the CouchSurfing Project, an excellent wt:hospitality exchange program that lots of people say good things about. There are apparently bunches of CouchSurfers in Montreal right now helping out with technical issues, content, support, and other great Website-errific stuff. Of course, the local CS community is practicing the ethic and sharing their homes with visitors. I'm not 100% sure how it works, CouchSurfing runs on a very collective model, and a lot of people are devoting their time to this get-together. I went to visit this afternoon, partly to catch up with Guaka, and partly to visit the collective. We talked a lot about the difference between Wikitravel and hospitality exchange -- how anonymous the sharing is for an information-oriented project like a wiki, versus the very intimate person-to-person nature of home sharing. I also talked for a while with Casey Fenton, the founder of CouchSurfing and a very nice guy. We all discussed how to let CouchSurfers copy and distribute Wikitravel guides, possibly customizing them for CS needs, and also for linking back to WT to update and improve the data on our guides. I'm pretty jammed on the whole CS thing -- I'm going to sign up quite soon. Should be fun. tags:

DekiWiki I'm interested to see how this OpenGarden thing works out for MindTouch. I saw a story about their Wiki product on Port 25, which I have to admit I read pretty regularly. Every once in a while there's something I should probably know. OpenGarden is MindTouch's Open Source initiative, including a wiki engine called DekiWiki, built on the .NET technology, and a wp:REST-based Web app framework called Dream. Apparently the whole thing runs fine on top of Mono, which means theoretically I could install it. But I haven't really done a lot of Mono web stuff before -- no idea how well it works. Also, have you noticed how people involved with Mono say "MOH-NOH", like the actual original Spanish pronunciation? Unlike everyone else, who calls it "MAH-NOH", like mononucleosis? That's a weird thing. OpenGarden has a MediaWiki conversion tool, which is almost a necessity for any wiki engine trying to compete in 2006. They might want to try lobbying those guys at the Mono Project... who appear to be using MW as their main site engine! Anyways, I'm going to give this DekiWiki a try. Who knows? It could be fun. I don't know about their overreaching claims for the GPL, but it can't hurt for a local install, right? I seem to remember there was a Scheme language plugin for .NET somewhere, too... By the way, I'm still bullish on JAMWiki, the MediaWiki-workalike using Java Web Services. But I like to experiment with new software, too. tags:

SocialText Speaking of commercial Open Source Wiki software, I was really glad to see that SocialText has released a FLOSS version of their flagship product. SocialText has been such a good corporate citizen in the wiki and FLOSS world. Not only were they instrumental in the launch of BarCamp, but ST employs some of the smartest wiki minds in the world today (like Seb and Sunir). And, of course, Ross Mayfield's blog is a great clearinghouse for wiki business info. ST has made a business model in training companies in the WikiWay. I think that makes a lot of sense, and they show a lot of commitment to the idea by demonstrations like this. tags:

Fired from Technorati for my UFO beliefs So, I was having some random and unpleasant 500 Server Error errors with this blog recently, and apparently Technorati has given up on my site in frustration. No matter how often I do an update, and then ping, it still doesn't refresh my recent articles. I'll have to figure out some tricks to get back in Technorati's good graces. I like the service a lot. tags:

Aigars Mahinovs: Why? Oh Gods! Why?


$ mv .ssh/ .ssh.old/
$ python
>>>import gnomevfs
>>> gnomevfs.get_file_info( "ssh://aigarius:password@aigarius.com/home/aigarius" )
Traceback (most recent call last):
File "<stdin>", line 1, in ?
gnomevfs.AccessDeniedError: Access denied
>>>
$ ssh aigarius.com
The authenticity of host 'aigarius.com (85.254.216.40)' can't be established.
RSA key fingerprint is 6d:29:c0:f3:d0:84:c9:a9:d9:4c:7e:e3:1a:18:a2:e2.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'aigarius.com,85.254.216.40' (RSA) to the list of known hosts.
aigarius@aigarius.com's password: *******
[...]
aigarius.com$ exit
$ python
>>>import gnomevfs
>>> gnomevfs.get_file_info( "ssh://aigarius:password@aigarius.com/home/aigarius" )
<gnomevfs .FileInfo 'aigarius'>
>>>
Of course, this is mentioned nowhere in the sparse documentation. Please keep me away from the person who wrote GnomeVFS and its Python bindings. Bloodshed might ensue. Bug reported Why can’t someone write a nice, light, working network file transfer protocol abstraction library that would be independent of any desktop environment (bonus) and a working X server (I am looking at you, GnomeVFS). Something that would simply provided all file and folder manipulation operations in sync and async ways in such way that those operations work completely uniformly across all supported protocols. Support for at least ssh and ftp is essential, webdav, nfs, rsync and other protocols that allow writing files to remote locations and http, https and other protocols that only allow read only access to remote files would be very welcome. The library should be in C with bindings in C++, Python, Perl, Ruby, PHP and also a command line processor that would allow all commands to be used in a shell script.
Why something like this can not be written and obsolete the GnomeVFS and those KIOslaves. Freedesktop.org, I am looking at you, please! Update: Apparently I only need to “import gnome.ui” and execute “gnome.ui.authentication_manager_init()” and my application will automagically get a proper authentication dialog in this case. Unfortunately it is not documented anywhere that I could find. :P

14 August 2006

Erich Schubert: SELinux for sarge updated

My experimental SELinux for Debian sarge backports have been updated. The core libraries and utilities are updated to the versions just uploaded to unstable. Therefore, they may of course contain the same bugs as the unstable versions and since I redid the packaging of libselinux and libsemanage - I didn't understand Manojs packaging system, and these packages needed larger modifications for sarge python support - they may also contain extra bugs. But even users of unstable might be interested in grabbing the "refpolicy" packages from this repository. These packages are now a modular policy. This is possible since the just uploaded toolchain finally has working policy module linking and results in a significantly smaller policy, since you don't have to add rules for software not installed. To support this, I've written a tool to resolve inter-module dependencies and to automatically install modules matching the software packages you have installed. Expect to see this in the unstable refpolicy packages sometime, too. Maybe someone else will contribute a ncurses frontend to select policy modules. Please note that bug reports should be directed to the Debian SELinux Mailing Lists. Please use the mailing lists, instead of just contacting me directly. On a side note, I don't know if I'll be continuing these efforts.

Anthony Towns: Debian news for the day

It’s time for LinuxWorld SFO, which means it’s time for lots of interesting announcements. A major one today is from Hewlett-Packard, announcing that they’re ready to support Debian GNU/Linux officially on their Proliant and BladeSystem servers, and as a side note that their revenues from sales of Linux servers has now hit six billion dollars a year over the past eight years. An interesting note from the IDG article above is IBM’s response:
“IBM works well with Debian in the Linux community and will, and does, support the Debian distribution for our customers,” the company said in a prepared statement. “It’s not a standard offering, but we do it under special bid.”
It’s interesting that vendors are seeing enough interest in Debian from their customers to be specifically supporting it, whether on an specially negotiated basis as IBM does, or now on a standard basis for entire product ranges as HP is. Personally, I find it really pleasing that companies are doing support for Debian not because we’ve negotiated with them, but because customers are asking for it. I’m also pretty pleased that HP’s commitment to Debian support doesn’t come at a cost to the support they’re offering for their other “tier-1” distributions: Red Hat and Novell’s Suse. To me, that’s what free software’s all about, friendly competition that’s focussed on making people’s computers work, not exclusive deals and promotional rights. Debian’s also been mentioned in a ZDNet story about Movidis MIPS servers, which have a nifty 16-core processor and seem to be aimed at video streaming and other tasks that are a mixture of storage and processor intensive. Interestingly, while the story mentions the use of a mildly customised version of Debian as their OS basis, there doesn’t seem to be similar mentions on either the Movidis or Cavium Networks sites, let alone any juicy technical details. Also interesting is this mention in a story about Zimbra groupware:
ZCS supports Microsoft’s Outlook messaging software and runs on the two leading flavors of Linux – Red Hat and Suse – and Apple Computer Inc.’s Mac OS X. Although ZCS also runs on Windows on the client side, Zimbra isn’t seeing interest from its customers in supporting Microsoft’s operating systems on the server side, Dietzen said. The start-up has a list of other operating systems it plans to support, notably the Debian distribution of Linux and Sun Microsystems Inc.’s Solaris flavor of Unix, he added.
Looks like the first efforts at Debian packaging are happening on the Zimbra forums already. And then, of course, there’s the announcements from last week, such as the Creative Commons 3.0 discussion draft, that’s trying to solve some of the conflicts between the expectations we have of free “software” licenses, and that others have of free “content” licenses. A lot of work’s been put into that already, and hopefully it’ll pay off for everyone. Or the recent betrayal of the Debian spirit by Linspire, encapsulated in this ComputerWorld headline: Linspire releases Freespire 1.0 early. Ah well, traditions have to end sometime I guess. Or there was OSDL’s announcement that they’ve signed up Debian deriver Xandros for their desktop working group, with the little side note dropped in that IDC estimate desktop Linux will be worth ten billion dollars in annual revenue beginning the year after next. Or there was OpenVZ’s announcement at being included in unstable recently (it’s also available in etch, and they’ve announced today a build for RHEL 4). Of course, I’ve also neglected to mention some much bigger Debian news, which is that as of Friday, etch beta3 is out, which is an excellent sign that we’re on track for release, even ignoring all of the nifty new features it includes. And heck, Debian’s birthday is still a couple of days off. In the meantime, I’m going to go to sleep, so I can make it to Novell’s launch event for Suse Linux Enterprise 10 in Brisbane tomorrow, and see what they’re up to.

Aigars Mahinovs: SBackup purge

SBackup Purge
Here is the first screenshot of a new tab in the SBackup configuration that allows you to automatically erase old backups. There are two options: plain and simple “keep backups for X days and then erase them” or the smart (and default) progressive trimming option in which you have more backups of recent times and fewer backups of less recent times.
Now that the interface is up, I will be coding the part that actually does the trimming. The tricky part is dealing with incremental backups in progressive purge scenario. I will need to do a lot of testing to insure that I get it right, before I release it. ObNotebook: A happy DHL courier woke me up today and picked up my laptop. I kept the harddrive. The courier said that usually Dell guys return the notebooks on the third day, so I could hope to get my laptop back on Wednesday.

Gintautas Miliauskas: Localization coordination for Debian #6

With the deadline approaching, it appears that my productivity is rising. Seems like the typical efficiency=1/days_left (and at T=0 my brain explodes). Basically I'm happy with what I have for DDTP. It will need some testing to replace the current system. One thing that I would like to have is package priorities: this has some support in the old system. I am not sure how to approach this yet, but I'm sure I'll think of something. Anyway, this is not a priority and will probably be settled after the deadline. Priorities for next (and last) week are to get the relational backend running and to write a guide to the API. I have already started work on the RDB backend. I am using SQLAlchemy as the wrapper. A nice side-effect is that SQLAlchemy supports SQLite, which means that getting the thing to run would be a snap, without requiring fancy configuration of MySQL or PostgreSQL. On the other hand, having these options allows better scalability as the database and the web server(s) can be separated. As for the guide, I am aiming for a style similar to library documentation on python.org. I expect no trouble here because I already have some experience with LATEX. Last but not least, I have to remember to clean up quite a few leftover TODO and XXX markers in the things that I have. Most of them are benign, however.

13 August 2006

Lars Wirzenius: Random thought: Quick! Press 3, click mouse button, press A, press 4, keep mouse button pressed...

I am in a murderous mood. Every time I see movement, my right index finger twitches. My head keeps jerking left, right, up, down. My ankle hurts because I almost twisted it, turning suddenly around when I heard a noise from outside. Today, instead of doing a bit of work that I left undone on Friday, and going to the gym, and making a nice meal, I ate leftovers and played Quake 2. Finished it, in fact. I probably died a hundred times, but eventually I got the bastard. Now I'm frustrated. I don't actually feel anything from the first paragraph. My ankle got hurt because I was trying to catch a bottle that fell off the table. However, I do feel frustrated. As I told before, some time ago I started looking at modern computer games, or rather, modern first person shooters, in single-player mode. I had a friend demo me a representative selection, and then got myself an authentic copy of Quake 2. I've now finished it, and I'm not entirely happy about the experience. The actual playing was OK while it lasted. The game is highly playable, the controls are easy, they quickly feel natural, and the game reacts to them very well. The only thing I never really got the hang of was jumping, but that was rarely necessary. The place with the three stones sliding around in water was quite annoying. Playing Quake 2 consists mainly of two things: shooting everything that moves, and solving small puzzles. The puzzles are mostly of the kind where you need to run around in buildings and twisty little corridors, all alike, and find a button to press. Not highly challenging, but if you miss one, you may have to run around the place an extra time or two, and that takes time, and gets quite boring. The shooting was also a bit of a puzzle, at times, since in order to not get shot yourself, you can't just stand in one place. In the ideal case, you can figure out a way to deal with the opponents from a safe place, throwing grenades around a corner or something like that. Mostly, though, you just shoot. Aim and click. Aim and click. Move about a bit. Aim and click. Aim and click. Move about. Aim and click. Continue until the thing blows up. The computerized opponents do get smarter, and a bit harder to kill, as the game progresses. The final big bad guy is really hard to kill, took me a dozen attempts. That turned out to be surprisingly unsatisfying. There is a storyline in the game, but it was pretty much irrelevant. There are several stages, and at each stage you need to do certain tasks, and as a result, you can go to the next task, or the next stage. All the tasks are "shoot everything" and "press a few buttons in the right order". Oh, sometimes you have to collect some items, too, and take them to places. Now that I've finished the game, I wonder if it was all worth it. I spent quite a number of hours on the game, and what I mainly got out of it was some adrenaline boosts, and those weren't enjoyable. They're addictive, even highly so, and every time I had to stop playing (to do work, or sleep), it required a lot of willpower. I wanted to continue, even if it wasn't fun. I hate being addicted. I can't deny having had a bit of fun. The feeling of being able to do things, to run tirelessly for hours, to overcome obstacles, to vanquish my foe, all that is fun, and gives a certain satisfaction. That satisfaction is feeble and fleeting. As soon as I re-focus my eyes, get up from the couch, and look outside, I realize that it was all for nothing. I haven't really accomplished anything. I'm a hacker. My life revolves around doing things with my brain, and having them affect the real world. I make software that other people use, and their lives get better, even if only a little. Every time I fix a bug in Debian, I improve the world. Heck, even just finding a new bug from piuparts log files gives me a nice, warm feeling in my stomach. I realize people don't play games to improve the world, and that's all right. I don't watch movies or read fiction to improve the world, myself. Computer games are a form of entertainment, and as long as they're fun, and you're enjoying yourself, they're fine. If playing makes you happy, be happy, and I'll be happy for you. I am not judging you in any way, I'm expressing my own feelings. I can't seem to get enjoyment from computer games, or at least I didn't get it from Quake 2. I got an adrenaline addiction, and a high frustration level. I do get distraction, something to take my mind off things, but I can get that from, say, romantic comedies, without any side effects. Thus I conclude that I am better off not playing first person shooter games. I suspect that no computer game is going to be particularly good for me. For many years now, I've played a bit of tetris, or Mahjongg, or a solitaire card game, when I wanted a bit of distraction. Those never were satisfying, either. While I did get distracted, somewhat, for a while, they didn't really work for that, either. Watching Lord Arthur and Miss Mabel get each other works much better. If I solve solitaire, nothing has changed; if I watch An Ideal Husband the nth time, at least I've felt something beautiful. A surrogate emotion is better than an adrenaline addiction.

Andree Leidenfrost: Of New Hardware, New Packages, Bugs & Kernels

I decided that before my socket 939 ASUS A8V Deluxe motherboard becomes obsolete, I should do an upgrade to dual-core. It so happened that my dealer had an Athlon64 X2 4800+ returned to him the other week, so I went for it. It's the fastest that the board supports and comes with juicy 2x 1MB L2 cache (which apparently got axed by AMD now as part of the price-battle with Intel). My only concern was about power/heat/noise because it's the 110W model, but to my delight it appears to be running cooler and quieter than the (130nm) 3500+ I had before. Cool! ;-) While I was at it I also doubled the RAM to 2GB and bought two SATA hard disks and a swappable tray system for them.

The latter was mainly so I could do some tests in regards to #380703. The outcome is that restore works fine with SATA disks on above motherboard using its Via SATA controller (haven't tried the Promise one yet). So far, so good - or rather bad, because I can't produce the problem.

At least I do have a fix for #379966 which basically entices the introduction of a new function mr_stresc() to properly escape things when using system() or popen(). It's gone through a few revisions both by the submitter and upstream (Thanks Steve & Bruno!) and should be in upstream soon.

For the time being, I have just uploaded mindi-1.09-1 and mondo-2.09-1. They are purely new upstream versions and don't close any of the open bugs - hopefully, this will follow soon. Testing was done on an etch system using a SATA disk and a sid system using PATA. The archiving mode was NFS both times and the kernel used was also the same, i.e. 2.6.16-2-amd64-k8-smp (2.6.16-17).

I am experiencing problems with 2.6.17 kernels and creating ISO images on NFS mounts using mkisofs. mksiofs would just hang sooner or later whilst writing the image file. With 2.6.16 there is no such issue. And neither cp nor dd have this problem with 2.6.17. Weird. I'll have to do some more testing and probably will bring it up on the debian-kernel list before I file a bug report.

Edd Dumbill: Ten things you need to know about me

To keep you reading all the way through, the best one's at the end.
1. I'm striking back out on my own againAfter a couple of years working full time in an office, I've decided it's the right time to take my own business, the Useful Information Company, further on. As the rest of this post illustrates, we'll be involved in web technology conferences, our own products, and Rails-based software development. I'm always looking for collaborators, comment and customers, so get in touch if any of this lot grabs you.
2. I'm organising an amazing web developer event in London, late OctoberUseful's first venture is XTech WebDev London. This is the first of a new type of event for XTech: a focused one-day training event for web developers. The idea is to focus on the best practice in web development that emerges from the cutting-edge work demonstrated in the regular XTech conference.This year, that means: Ajax, web standards, open data, REST and Ruby on Rails. Any web developer wanting inspiration and a view of the future should come along. London, UK. October 31, 2006. You can reserve your place now. (We're right-priced for your training budget, and start late enough that folks could make it from all over the UK and beyond without staying a night.)
3. The pace is hotting up for XTech 2007 in ParisMeanwhile, I'm busy putting together the call for participation and programme committee for XTech 2007, in Paris, France. Our theme is "The Ubiquitous Web." As keynotes, I'm pleased to welcome Adam Greenfield, Matt Webb and Jack Schulze.
4. I'll be off travelling shortly and reconnect with old and new friends Though a little daunted by the new face of air travel, I'm heading out to O'Reilly in Sebastopol at the end of this month to take part in FooCamp. One of my main aims is to seek out the ingredients required for a successful professional online community. In September I'll be putting in some time at EuroOSCON. Both visits will let me hook up with friends, many of whom I've not seen for a couple of years.
5. I'm on the programme committee for O'Reilly's Emerging Technologies 2007 conferenceThis one has me interested and engaged. Rael Dornfest is due to unveil the call for participation in a couple of weeks' time, and I'll give my take on the conference then. The show itself is March 26-29, 2007.
6. I have an exciting startup under the covers, in the area of conference and event managementOne of the things I've done a lot of over the last half-decade is organise, coax and bully people into presenting at conferences. I'm pouring what I've learned, and more besides, into a great product. You'll soon be bored of me talking about it.
7. I'm involved in taking Pharmalicensing into an exciting new phasePharmalicensing is an online exchange for intellectual property in the biotech and pharmaceutical world. I was part of its foundation in 1998, and am still involved. I will be part of a newly energized team of people pushing it forward into 2007. 8. I'm having a bit of a clean-out of projectsAlas, with so much going on, I need to cut out a few existing commitments. One of these things will be Monopod, my Mono-based podcast client for Linux. If I can't find anybody interested in its maintenance, I'll just hang the source code out there for anyone to pick up.
9. I want to get more energy put into DOAPOne of my long term projects I definitely don't want to cut out is DOAP, my project to describe software projects in RDF. It's had a slow but sure take-up over the last few years, and is finding its way into some significant projects. However, I do need a bit more energy for it, and one or two collaborators would certainly help. 10. Around Christmas-time, I'm going to become a father to twinsI've still not recovered from the shock. Rachael and I are going to be the proud, stunned, parents of a couple of bright shiny bundles of Human 2.0. Completely awesome, and I've absolutely no idea what to do! For now, we're just concentrating on throwing enough junk out to make room for them.

Daniel Stone: [tech/x] ati and open source

Daniel, if you can somehow build a card that's at r2xx level (note the current state of the art is r5xx), not to mention be register-compatible, you are nothing short of a genius, and ATI and NVIDIA will be begging you to let them pay you a number of your choice.

It's not going to happen anytime soon. They're not worried about that.

Andrew Pollock: [tech] More benchmarking

When I did my Red Hat Certified Engineer training, the second time around (when I updated from Red Hat 7.1 to Enterprise Linux 3), the trainer mentioned this Ext3 vs Reiserfs benchmark that Gurulabs performed. Probably because it had such a memorable name, I've remembered it and referred people to it, and referred to it myself, a few times over the years since. So it seemed only fair to try out their benchmarking methods (i.e. use NetApp's postmark with a few different settings) on the uber-disk as well, while I had it idle. So I did. Firstly, I ran it locally on minotaur, the piddling little 866Mhz Pentium III, with 320Mb of RAM (but with 1.5Tb of disk attached directly via USB), and then I ran the exact same tests from teevee, the box destined to become my MythTV server (3.0Ghz Pentium 4, 1Gb of RAM), with the disks mounted with ATA over Ethernet. This was with a JFS filesystem on a single logical volume striped across four physical volumes. I ran the tests three times, just like the Gurulabs benchmark, first time around, it was with: The idea being that this will generate around 150Mb of data, which should all fit in the RAM (of either system) The second time around was with: The idea being that this, generating 1400Mb of data, will exceed the RAM on both systems (but not uniformally, obviously). The final run was a total thrash with: This one causes about 19Gb of data to be written, and absolutely hammers the living daylights out of the disks (or the network, and the disks, in the case of ATAoE). So, now for the results:
Test case 1, with locally attached disks
Time:
        22 seconds total
        21 seconds of transactions (2380 per second)
Files:
        27170 created (1235 per second)
                Creation alone: 2000 files (2000 per second)
                Mixed with transactions: 25170 files (1198 per second)
        24986 read (1189 per second)
        24697 appended (1176 per second)
        27170 deleted (1235 per second)
                Deletion alone: 2340 files (2340 per second)
                Mixed with transactions: 24830 files (1182 per second)
Data:
        149.53 megabytes read (6.80 megabytes per second)
        161.85 megabytes written (7.36 megabytes per second)
Test case 1, with ATAoE attached disks
Time:
        27 seconds total
        25 seconds of transactions (2000 per second)
Files:
        27170 created (1006 per second)
                Creation alone: 2000 files (2000 per second)
                Mixed with transactions: 25170 files (1006 per second)
        24986 read (999 per second)
        24697 appended (987 per second)
        27170 deleted (1006 per second)
                Deletion alone: 2340 files (2340 per second)
                Mixed with transactions: 24830 files (993 per second)
Data:
        149.53 megabytes read (5.54 megabytes per second)
        161.85 megabytes written (5.99 megabytes per second)
Findings
A degradation in performance, sure, but not a huge one. Graph of the results
Test case 2, with locally attached disks
Time:
        218 seconds total
        209 seconds of transactions (239 per second)
Files:
        27144 created (124 per second)
                Creation alone: 2000 files (400 per second)
                Mixed with transactions: 25144 files (120 per second)
        24830 read (118 per second)
        25094 appended (120 per second)
        27144 deleted (124 per second)
                Deletion alone: 2288 files (572 per second)
                Mixed with transactions: 24856 files (118 per second)
Data:
        1405.24 megabytes read (6.45 megabytes per second)
        1535.91 megabytes written (7.05 megabytes per second)
Test case 2, with ATAoE attached disks
Time:
        165 seconds total
        158 seconds of transactions (316 per second)
Files:
        27144 created (164 per second)
                Creation alone: 2000 files (1000 per second)
                Mixed with transactions: 25144 files (159 per second)
        24830 read (157 per second)
        25094 appended (158 per second)
        27144 deleted (164 per second)
                Deletion alone: 2288 files (457 per second)
                Mixed with transactions: 24856 files (157 per second)
Data:
        1405.24 megabytes read (8.52 megabytes per second)
        1535.91 megabytes written (9.31 megabytes per second)
Findings
Whoa, who'd have thought this? Better performance over the wire? I'm blaming the fact that minotaur is a bit of a weakling compared to teevee, and teevee had a better caching advantage with more RAM. Mind you, you'd expect to see the same for the first test as well, unless size is a factor. Inconclusive results I guess. Graph of the results
Test case 3, with locally attached disks
Time:
        7356 seconds total
        7310 seconds of transactions (27 per second)
Files:
        104099 created (14 per second)
                Creation alone: 4000 files (117 per second)
                Mixed with transactions: 100099 files (13 per second)
        100246 read (13 per second)
        99560 appended (13 per second)
        104099 deleted (14 per second)
                Deletion alone: 4198 files (349 per second)
                Mixed with transactions: 99901 files (13 per second)
Data:
        18995.06 megabytes read (2.58 megabytes per second)
        19738.85 megabytes written (2.68 megabytes per second)
Test case 3, with ATAoE attached disks
Time:
        12320 seconds total
        12111 seconds of transactions (16 per second)
Files:
        104099 created (8 per second)
                Creation alone: 4000 files (32 per second)
                Mixed with transactions: 100099 files (8 per second)
        100246 read (8 per second)
        99560 appended (8 per second)
        104099 deleted (8 per second)
                Deletion alone: 4198 files (49 per second)
                Mixed with transactions: 99901 files (8 per second)
Data:
        18995.06 megabytes read (1.54 megabytes per second)
        19738.85 megabytes written (1.60 megabytes per second)
Findings
So presumably the network latency made its presence felt with data volumes of this magnitude. Graph of the results

12 August 2006

Alex de Landgraaf: Procrastination!

A quick update is in order:
On Debtags/AI, Erich and I have rewritten the naive bayesian tagger in python (well, Erich did most of the fun stuff :) Performance seems comparable with the old tagger, however the new one is a lot quicker and more flexible, I've rolled it into a library and will make more improvements over the next few weeks. I have been dragging my feet quite a bit though, and have agreed to work on the project until it's finished in spite of the impending deadline. On my master-thesis, lots of talk, a bit of hacking but not enough writing. I hope to have some peace and quiet the next few weeks so I can get some more inspiration, as I really do want to finish my thesis within a reasonable amount of time... Wow, almost two weeks since my last blogpost. I really have been slacking. In 7 hours I should be on my way to the camping where my girl is working this summer. These last few weeks have been long and I'll be glad to hold her once again :) (and to all the other people who want me to get stuff done: I'm taking my laptop with me and see it more as a country-side office with a swimmingpool :)

Daniel Burrows: Giving away secrets

Erich Schubert writes that


Oh, and I actually doubt that ATI would give away much secrets if it would allow distributing the existing opensource X drivers. It's not as if the specs of their CPU would be a huge surprise to Nvidia. Some actually say nvidia builds the better graphics cards. And Intel does even give away source code. We're not talking about chip design here, or driver optimizations. Just the plain registers and ports.


-- note: what follows is just my opinion and I'm wrong on a regular basis, so take it with a grain of salt --

The problem here is you aren't thinking like a corporation. As far as I can figure, the corporate view here is that you have two options:

(a) Keep the secrets you have. This is the status quo, you know how to make money here, and no-one else can benefit from your secrets even if you yourself can't.

(b) Give away your secrets. This always carries a risk that someone else will find a more clever (=profitable) way to use your secrets than you; thus, companies try to avoid this unless they absolutely have to.


I personally agree that the risk to ATI appears small. However, just to throw out a hypothetical, giving away their register specs would allow other companies to build cards that are register-compatible with ATI's. (Remember the ne2000?) Obviously this would be good for you and me -- but it's almost certain to drive down ATI's profits at least a little by providing more direct competition in the market for graphics cards; thus it's not good for ATI. This may be a far-fetched or overblown concern, but ATI will need a reason to "go uphill" against it when their current strategy seems to be doing just fine.

Intel, on the other hand, is in a different situation; as far as I know, they generally are playing catchup in the graphics area to NVIDIA and ATI, and as a result, they have more to gain and less to lose by opening their specs. [UPDATE] And as I mentioned in my previous post on this topic, the types of cards Intel sells are probably more interesting to free software users than the cards ATI sells. (I'm sorry you don't have any Intel cards -- they seem to have come automatically with most of the new computers I've seen lately, so I assumed it was a trend!)

Aigars Mahinovs: Simple day

I spent the whole day today investigating and fixing SBackup bugs and adding new features. The 0.10 release will be da bomb! My current plan is to spend 10 more hours on this tomorrow and after that I will declare a feature and string freeze for 0.10 and will give the translators a day or two to make/update their translations. And at the same time I will be figuring out a good systematic way to test a SBackup release. It is an important package, but it has no automatic or even manual tests, which is not nice at all. So while translators will be translatig, I will be testing. Ah, and this blaze of activity is thanks to both Jonh who contributed i18n code and some fixed to SBackup a few days ago (I hope he will continue contributing in the long term) and a brakedown of my primary laptop which makes it hard for me to do my university work. (I had no backups configured there yet :P )

Daniel Burrows: Explaining Network Neutrality

One of the problems with network neutrality is that people outside the technology industry often can't follow the arguments back and forth because of the complexity of the terms involved. On my vacation last week, I found myself discussing this topic with my ~80-year-old grandparents. Now, Grandpa and Grandma have no clue about technology, but they aren't dumb; they are both retired educators and follow current events (especially politics) with a strong interest. In my effort to explain just what the fuss is about, I had a sudden brainstorm and came up with the following analogy, which I post here for anyone who cares to use it:


Imagine that your power company decides that it wanted to open a line of supermarkets. At the same time, it sends out an announcement that supermarkets (due to their refrigeration requirements) are particularly heavy users of the electrical system, and as a result, the power company will add a 15% surcharge to the power bills of any building that it deems to be a supermarket. Of course, the power company's own supermarkets are exempt from this fee. When the existing supermarkets complain, the power company says that they're asking for special treatment and trying to get electricity "for free" and that if they don't like its terms, they should buy their power from someone else.


Obviously this greatly simplifies the technical issues involved, but it's the best illustration of at least one aspect of the problem that I've been able to come up with. I've enabled comments for this post, so feel free to add your own suggestions.

Daniel Burrows: We aren't ATI's market.

Erich Schubert noted that ATI is holding onto their closed drivers. While it's unfortunate, I don't think this should be surprising to anyone. NVIDIA and ATI make their money by selling cards for gamer types, who make an art out of trying to get the latest super hardware to play the newest snazzy games on. They don't give a hoot about source code access -- after all, they're probably running proprietary games on a proprietary operating system anyway.

Free software enthusiasts, on the other hand, spend their free time hacking code and so don't have time to play the massive productions the game industry puts out nowadays; frozen-bubble or Wesnoth are about as much gaming as we have time for. As a result, we can do just fine with a video card capable of displaying Emacs, a couple xterms, and maybe a graphical Web browser -- and the built-in graphics card (usually Intel) on the motherboard is just fine for that. We also tend not to run Windows or OSX, where 99% or so of graphically intensive games come out, so even if we HAD free time for gaming we wouldn't be able to do it on a free system.

As a result, while I'd certainly like to have free ATI drivers, I think it's unrealistic to expect them anytime soon. ATI is a company, not a charity, and they will not provide source code or specs until it will clearly benefit them more than it hurts. If you don't believe me, try walking into your manager's office and saying "hey, I have a great idea! Let's give away all our secrets without any clear way to make money off it!" and see how he reacts. (note that this experiment may not apply to the 1-5% [0] of readers lucky enough to work in academia)

[0] this statistic determined by the HIGHLY SCIENTIFIC method of picking a small number at random.

Next.

Previous.