Search Results: "tar"

16 January 2010

Stefano Zacchiroli: RCBW strike - BSP in Moenchengladbach

RC squashing news In the last two weeks I didn't progress as usual with RC bug squashing, even if I've some squashes to share: The reason for my under-activity are that for a week I'd relatively scarce network connectivity, which is a badly needed good for RCBW. Then, this week, I got swamped by various tasks at the university (including co-authoring a paper with Lucas, more on this (hopefully) in the future). My residual RCBW time has been devoted to write a page about RCBW where I've tried to summarize my initial motivations and the main points of the initiative, which I consider established by the first 18 weeks of activity. Starting from next week I'll be back with daily squashes. In the week-end ... drum roll ... I'll be attending the BSP in M nchengladbach, hosted by Credativ; I'll personally be kindly hosted by bzed which I thank already for that and for the BSP organization. See you there (!?)

15 January 2010

John Goerzen: Netbook or thin & light notebook?

I am a big fan of thin and light notebooks. I ve been using the 9 EeePC 901 for awhile now, almost since it first came out. I initially loved it. The keyboard, while an obstacle, wasn t as much as I feared. The thing got insanely long battery life (5-6 hours or more typical), and was so small that my laptop bag is a DVD player bag . Now for the downsides. I am getting into a time where I m spending more time on the laptop, and I m starting to be far more acutely aware of them. #1 is performance. Let s face it: the 901 is just a slow machine all-around. The video performance isn t great, and I can watch the Thunderbird interface being drawn as it loads. But the real killer is the SSD storage. It is exceptionally slow, and gets in the way of multitasking in a serious way. (Syncing mail? Kiss performance in Firefox goodbye.) Problem #2 is the 1024 600 screen. This is becoming a serious inconvenience, as when you combine the need to do a lot of scrolling with slow scrolling performance, the result is unpleasant. Coding is pretty difficult at that size. #3 is the keyboard size. It is OK for light-duty work, but it is getting in the way for more serious work. So I m looking for a replacement. I m thinking something in the 10 to 12 range, thin and light, would be ideal. My main criteria are size, weight, performance, and compatibility with Debian. Durability is an added plus as it will be riding in my bicycle bag on a regular basis. This puts me in something of a grey area: there are netbooks in that range, and then there are machines like the Macbook Air (which may actually be a bit bigger than I d like). I have recently been hearing good things about the EeePC 1005PE (Atom N450) and the 1201N (N270 with Nvidia Ion). The 1201N seems to beat the 1005PE in terms of performance (especially video-related), but with far less battery life. I think I could live with the slower CPU, but the 1005PE still has only 1024 600 resolution, which would be a big problem for me. Lenovo has an IdeaPad U150 with an 11.6 1366 768 screen, and in the 12 size, they ve got various options, both Atom and Core 2 Duo. The X200 and X200s look interesting, but lack a touchpad. (The X200s appears to be their long-lasting-battery version.) The HP EliteBook 2530p also looks interesting; it has a touchpad, but is heavier and appears to have inferior battery life to the X200s. What ideas do people have?

Roland Mas: FusionForge developers/users meeting coming up

News is slow this month on the FusionForge development front. We're all busy gathering all the things that we want to go into the next release, but there's no big news from the code. However, there is something of interest. You may have heard about the Coclico project, which is an initiative aiming at collaboration and convergence between several forge engines, most notably FusionForge, Codendi and Novaforge. That project was started last October, and it holds regular meetings with its members. The next meeting is scheduled for the 2nd of February in Paris, and we thought we could host an open meeting on the 3rd for non-Coclico members, a bit like the forge meeting we had last year (which is when FusionForge was officially born), but with an emphasis on what Coclico did so far. Since most of the FusionForge hackers are in Western Europe, and several are in Paris (especially if we add those who go to Paris for the Coclico meeting), we thought it would also be a good opportunity to gather for a technical and social meeting. It seems the Coclico open session didn't generate much interest this time (at least, it hasn't so far), so I proposed to hijack the room for this FusionForge meeting, and I didn't hear any objections. I have several themes I'd like to discuss with people, and possibly start implementing during that day: and so on. These are in no way specific to FusionForge, and in fact I think it would be great if hackers/users of other forges were present, because we could benefit a great deal from their experience and plans. But if we find ourselves amongst FF people only, I think these would be good to discuss, possibly write some code for, and go home with a clearer picture of where our efforts should focus in the near future. I'd therefore like to invite interested people to mark the 3rd of February on their agendas. The meeting will take place in Issy-les-Moulineaux (near Paris, within reach of the tube). If you're interested, please get in touch with us (#FusionForge on the FreeNode IRC network, or the fusionforge-general mailing-list), so we can have a rough estimate of how many people to expect. The meeting room is provided by France T l com, and they're probably going to need numbers if not names. Further details will be announced when known.

Christian Perrier: Samba 3.4.4 in unstable

It tooks me one week, this time after Karolin released upstream samba 3.4.4, to get Debian packages in unstable. That release will unfortunately be the first to use a "~dfsg" suffix to upstream version. In short, upstream used to distribute RFC files in their tarball. They first removed them when we pointed them at this (because we had an RC bug by our zealous "non-free documentation" hunters). However, they were reinstated after a discussion in upstream lists where it was pointed that these RFC files were needed for Samba 4 sources (that are distributed along with Samba 3 though not used to build Samba 3 packages). So, well, even though I don't feel really concerned by cutting hair in 4 about documentation files freeness, I fixed this by repackaging the upstream tarball without these files. I did choose to use "~dfsg" as suffix so that someone wanting to upgrade from our packages to some unofficial packages using the standard versioning (such as SerNet packages) can do it.

14 January 2010

Jonny Lamb: Monorail

Recently, I've been working on a file transfer app for the N900. It's called monorail and I uploaded it to extras-devel last night, so you can try it out right now. Click for full-sized image I implemented an OssoABookContactView with support for filtering on Contact Capabilities (or a draft of it, at least) as old-style caps aren't great. This gives a nice list of address book contacts who have at least one account that should support receiving file transfers. It would be nice if these extra caps could go into the address book which is where they belong, but it won't. If someone would find this widget useful, I'll clean up the code and maybe throw it in its own library. Click for full-sized image
Choose one of the accounts which support file transfer. I also started to implement a sharing plugin, but it turns out it's poorly documented and appears to be impossible to do anything useful for my use-case, like popping up a dialog when the user taps "Share". The example isn't very exemplary, but does contain some amusing code. This sharing plugin is only half-written and impossible to debug. If anyone has any pointers on writing these plugins, I would appreciate them. Click for full-sized image It's a shame that although Hildon widgets can look really good on the device, it can often take some fiddling to make them look consistent with the rest of the UI. Additionally, oddities in some widgets can leave you baffled, or amused. The most annoying thing I have come across regarding this app is just how little I can get it integrated. The file manager is all hard-coded so there's no way to add a Send to Contact menu item, and no buttons can be added to the libsharing dialog (which appears when the user shares a photo) which is annoying as it looks like it's missing this feature. Click for full-sized image Oh, and Telepathy is pretty sweet.

Sam Hartman: Open Source Accounting Software

I m developing a huge backlog of things to write about, going back as far as a couple of posts inspired by the Kerberos conference in October. However, those require more effort putting together the post, so I m going to focus on something more recent. Part of running a business even a small business like Painless Security is dealing with the administrative and bookkeeping. The normal solution seems to be Intuit s Quick Books. When I set up the company, I looked into that. However, Intuit s accessibility story starts with give up, and goes down hill from there. Apparently, screen reader vendors have offered to work with Intuit to help them, but have been turned down, or at least that s the strong implication I get from reading blogs from these accessibility vendors. So, I d definitely rather not give Intuit my money. I m also looking for a bit more than the minimum in accounting software. Keeping the books in order enough to pay taxes would be easy. However I want to be able to understand where I m making money; I want to be able to figure out if the fixed price contracts I enter into end up being good ideas. I want to understand how expensive community projects Painless Security gets involved in like Debian and IETF work are both in terms of direct costs and opportunity costs. I want to understand what sorts of work ends up being the most profitable. All of these are fairly typical management questions; solutions to varying degrees are understood. however it means I m actually going to use an accounting product more than just to track my invoices and prepare taxes. I decided to see what the open source world was like in this space. I started with Ledger SMB. Ledger SMB s main claim to fame is that it tries to be better than SQL Ledger. Being better than SQl Ledger is definitely a good thing. It worked well enough to generate invoices and income statements. It nominally had facilities to track the sort of per-project information I m looking for, but the facilities are not near good enough. Also, there were some issues things like the fact that total debits didn t particularly need or tend to sum to total credits got old after a very short while. Also, facilities for correcting mistakes were unfortunate. You could either operate in a mode where you could delete a transaction, or a mode where you reverse transactions. Deleting transactions in practice meant deleting most of a transaction; balances became out of sync and half of the transaction tended to stick around using some interfaces but not other interfaces. Database cleanup was almost always required. In principle, reversals are better. However, there is no facility to indicate that you re not expecting payment on a reversed invoice. The receivables/payables account balance out because of the reversing transaction, but both the reversing and reversed transaction end up becoming over-due. Hey, can you please send me some anti-money to clean this up? The code was dreadful; the goal was to have better abstraction than SQL Ledger. Perhaps that was achieved, but man that leaves a lot to desire. Now, I m playing with Open ERP. It wants to grow up some day to be a competitor to SAP R3. In a way that sounds good, although it does mean there s a high complexity cost. There s a lot of functionality. There s reasonably good separation between view and model (and possibly even controller). The code is often clean, although the random blocks of commented out code with no explanation cause me to cringe. Many aspects of the system seem incredibly well designed; you can approach the system through a web client, graphical client, two different RPC mechanisms, XL and Open Office plugins. However, there s this mix of missing stuff and completely broken that causes me to wonder whether I m going to be sad. First, there appears to be basically no support for the US. All addresses are European format and are hard coded. Each individual report needs to be changed. Recently, I found cases where as best I can tell debits and credits are just reversed. I ve found a case where backing up the database succeeds but generates a zero length file. I almost lost data through that last one. There s a complex set of mechanisms to deal with units-of-measure for products for example, some jobs billed in hours, some are billed in days. However other parts of the code just add quantities. Playing around with this I am reminded again that I really enjoy thinking about these sorts of problems. An interesting ERP project could be fun to work on. for example, I bet handling ERP needs for some cloud-centered company would be a lot of fun. Also, as part of looking at Open ERP, I ve more or less developed the necessary scripts to migrate a simple service company from Ledger SMB to Open ERP. There are limitations of course, but if this would be useful to you, drop me a line.

Russell Coker: Links January 2010

Magnus Larsson gave an interesting TED talk about using bacteria to transform dunes into architecture [1]. The concept of making a wall across Africa to stop sand dunes from overtaking farm land is obviously a good one, the idea of using bacteria to convert sand into sandstone to do so cheaply is also good. But making that into houses seems a little risky. I wouldn t want to live under shifting sand with only bacteria generated sandstone to protect me. Cory Doctorow gave an interesting speech titled How to Destroy the Book , here is the transcript [2]. He talks about how much he loves books and described his opposition to the DRM people who want to destroy the book culture. Sendmail has a DKIM Wizard for generating ADSP (Domain Signing Policy) records [3]. If I knew that ADSP records were so easy to implement then I would have used them a year ago! Loretta Napoleoni gave an insightful TED talk about the economics of terrorism [4]. Apparently the US dollar used to be THE currency for international crime, when the PATRIOT act was passed it s anti-money-laundering provisions encouraged many shady people to invest in Euros instead and thus led to the devaluation of the US currency. It s also interesting to note that terrorist organisations are driven by economics, if only we could prevent them from making money Ryan Lobo gave an interesting TED talk about his photographic work [5]. The effectiveness of the all-women peace-keeping force is noteworthy. The part about the Liberian war criminal who has become an evangelical Christian and who now tours Liberia begging forgiveness from his victims (and their relatives in the case of the people he murdered). Should someone like that be permitted to remain free if his victims forgive him? Charles Stross has an appealing vision for how Apple and Google can destroy the current mobile telephony market [6]. I can t wait for the mobile phone market to be entirely replaced by mobile VOIP devices! James Geary gave an interesting TED talk about metaphors [7]. The benefits of metaphors in poetry are well known (particularly in lyrics), but the impact of metaphors in influencing stock market predictions surprised me. Shaffi Mather gave an interesting TED talk about his company that makes money from fighting corruption [8]. Instead of paying a bribe you can pay his company to force the official(s) in question to do the right thing. Apparently the cost of doing so tends to be less than 10% the cost of the bribe if you know what you are doing. His previous company was an ambulance service that charges what the patient can afford is also interesting. John Robb wrote an interesting article about lottery winners and griefers [9]. He suggests that publishing the names, addresses, etc of rich people will be a new trend in Griefing. One thing I ve been wondering about is the value of the HR database at a typical corporation. A single database typically contains the home addresses, phone numbers, and salaries of all the employees. It would be very easy to do an SQL dump and store it on a USB flash device to carry out of the office. Then it could be sold to the highest bidder. They could probably make a market in the private data about rich people in the same way that there is currently a market for credit card data maybe they have already done this but it s kept quiet to stop others from implementing the same idea. Michael Smith wrote an interesting article for the Washington Times about home schooling and socialisation [10]. It seems that people who were home schooled as children tend to be more academically successful and involved in civic life as well as being happier and having career success. Richard Seager wrote an interesting article for American Scientist about ocean currents and heat transfer from the tropics [11]. It seems that when the ocean currents shut down the UK and other parts of northern Europe won t be getting a mini ice-age. Ian Lance Taylor (most known for the gold linker) has written a good summary of the situation in regard to climate change and what must be done about it [12]. The Wrath of the Killdozer article about how one angry man converted a bulldozer into a tank [13]. This wasn t a big bulldozer (every mining company has bigger ones) and he didn t have any serious weapons (only rifles). Imagine what terrorists could do if they started with a mining vehicle and serious weapons Simon Singh has written about being sued for libel by the British Chiropractic Association [14]. The BCA didn t like his article criticising chiropractors for claiming to be able to treat many conditions unrelated to the spine. Remember, chiropractors are not doctors all they can do is alleviate some back problems. See a GP if you have any medical condition that doesn t involve a sore back or neck. Avoid uppity chiropracters who claim to be able to cure all ills. Nicholas D. Kristof wrote an interesting article for the New York times about how happy the people in Costa Rica are [15]. He claims that the Costa Rican government s decision in 1949 to dissolve it s armed forces and invest the money in education is the root cause of the happy population. Maybe if the US government would scale back military spending the US population could be as happy as the Costa Ricans. While there are good arguments for having some sort of military, there are no good arguments for spending more money on the military than the rest of the world combined (as the US does).

13 January 2010

Adrian von Bidder: Nikita

Having stupidly, and very painfully, ruptured a ligament in my foot (while getting off a bus. Not drunk, no sports whatsoever.) I was less mobile than I wished to be and could finally make some time to watch Nikita by Luc Besson (I've not seen much he was involved in; L on was one of the exceptions which I like very much. I've got the DVD of The Fifth Element right here, so no need to chastise me that I haven't seen that one yet.) But back to Nikita: you may know that I like strange movies for some values of strange. Nikita obediently starts off in a very dark mood. And then suddenly turns into quite a normal secret service thriller with a romance element. I liked both parts of the movie very much, but it took me a bit by surprise at first. I also like fun stuff, and so I've watched my first three episodes (9 to 11) of Kottan ermittelt, wonderfully silly Austrian whodunnits from the late 70s/early 80s. If you don't speak german (and understand it well, even I have difficulties understanding some of the Viennese dialect), you just don't know what you're missing. Or if it is translated (don't know): probably like watching Bienvenue chez les Ch'tis in German. Which I did, because my french is not that good, but I'll have to watch it again en fran ais, just to get the Authentic Expierence of this wonderful movie. Update: Speaking of a foot, and of movies: I don't think I've mentioned My Left Foot on my blog so far. The biography of Christy Brown, a cripple who grows up in a poor Irish working class family to finally become a famous artist. I found it just a bit corny (hmm. Not sure if that's the right word here, shows up for kitsch in any case), but still very impressive.

Matt Brubeck: Finding SI unit domain names with Node.js

I'm working on some ideas for finance or news software that deliberately updates infrequently, so it doesn't reward me for checking or reloading it constantly. I came up with the name "microhertz" to describe the idea. (1 microhertz once every eleven and a half days.) As usual when I think of a project name, I did some DNS searches. Unfortunately "microhertz.com" is not available (but "microhertz.org" is). Then I went off on a tangent and got curious about which other SI units are available as domain names. This was the perfect opportunity to try node.js so I could use its asynchronous DNS library to run dozens of lookups in parallel. I grabbed a list of units and prefixes from NIST and wrote the following script:
var dns = require("dns"), sys = require('sys');
var prefixes = ["yotta", "zetta", "exa", "peta", "tera", "giga", "mega",
  "kilo", "hecto", "deka", "deci", "centi", "milli", "micro", "nano",
  "pico", "femto", "atto", "zepto", "yocto"];
var units = ["meter", "gram", "second", "ampere", "kelvin", "mole",
  "candela", "radian", "steradian", "hertz", "newton", "pascal", "joule",
  "watt", "colomb", "volt", "farad", "ohm", "siemens", "weber", "henry",
  "lumen", "lux", "becquerel", "gray", "sievert", "katal"];
for (var i=0; i<prefixes.length; i++)  
  for (var j=0; j<units.length; j++)  
    checkAvailable(prefixes[i] + units[j] + ".com", sys.puts);
   
 
function checkAvailable(name, callback)  
  var resolution = dns.resolve4(name);
  resolution.addErrback(function(e)  
    if (e.errno == dns.NXDOMAIN) callback(name);
   )
 
Out of 540 possible .com names, I found 376 that are available (and 10 more that produced temporary DNS errors, which I haven't investigated). Here are a few interesting ones, with some commentary: To get the complete list, just copy the script above to a file, and run it like this: node listnames.js Along the way I discovered that the API documentation for Node's dns module was out-of-date. This is fixed in my GitHub fork, and I've sent a pull request to the author Ryan Dahl.

Russell Coker: My Ideal Netbook

I have direct knowledge (through observation or first-hand reports) of the following use cases for Netbooks:
  1. System administrator s emergency workstation something light to carry when you might get an SMS about a problem.
  2. A really small laptop for a serious technical user, can be used for programming and other serious tasks. Only someone who is really dedicated to the hobby of computing would choose a system with a tiny screen for their main computer so that they can take it everywhere.
  3. A computer for a child. Children are less demanding about some aspects of their computer experience, no-one wants to buy a really expensive toy for a young child, and children find it difficult to carry full size laptops.
1 and 2 are the options that interest me. But it would be good if the extensive children s toy market could drive economies of scale and reduce the expenses of my hobby and profession. I have found my EeePC 701 to provide adequate CPU performance (Celeron-M 630MHz) for light compiling tasks and I have used it for some Debian development work. The SSD that is built in is very fast and OpenOffice load times compare well to my Thinkpad T41p because of it. The main problems I have with my EeePC for sysadmin and coding tasks are the small keyboard (which can t be fixed the overall size of the machine needs to remain small), the small screen (which could be expanded without changing the case size), the low resolution screen (which has been fixed in newer netbooks), and the fact that my 3G dongle sticks out and is likely to get broken. More recent Netbooks address these issues while having the trade-off of being heavier and larger. There are also some tasks which are generally not performed on a Netbook but that could be if it was properly designed. Here are some examples of things that I think should be done on a Netbook:
  1. Basic image editing and blogging something that a lot of people do on smart-phones nowadays. It can be done more effectively and with less effort on a general purpose computer I can t imagine the GIMP or Inkscape running on a smart-phone.
  2. Reading electronic books. The number of people who want a Netbook but don t want to read electronic books would be quite small as would the number of people who only want to read electronic books and never want to use a general purpose computer while travelling. No-one really wants to carry both a Netbook and an ebook reader at the same time.
  3. Watching movies.
  4. Everything that you might want to do on a terminal in an Internet cafe those machines are always 0wned, just say no for security reasons.
  5. Games. The Nintendo DS has two ARM CPUs running at 66MHz and 33MHz and a combined screen resolution of 256*384*18bpp [1] and the Sony PSP has a 333MHz MIPS R4000 CPU and a screen resolution of 480*272*24bpp [2]. The original EeePC had more CPU power and more screen resolution than the DS and the PSP so it IS suitable for games even though it won t run the latest 3D games. There are lots of great games like Wesnoth that don t require much video performance.
  6. Educational Software. Portable educational devices include the awful V.smile system for young children [3] and the educational software for the DS (I ve seen a demonstration of a training program in rapid completion of basic maths problems for elderly people and presume it s not the only educational software on that platform).

Image editing requires a color screen of high resolution. Effective blogging requires a platform with a resolution that compares to the typical web user according to Hitslink 1024*768 is the most popular resolution of web browsing systems at 28.34% and the most popular resolution that is less than 1024*768 is 800*600 at 3.28% [4]. So even the most casual blogger will have an incentive to get a screen that is of higher resolution than all but the latest Netbooks. The recently released EeePC 1201 has a screen resolution of 1366*768 which should be barely adequate for those tasks. Reading electronic books requires a reasonable resolution. Based on my experience with the 1400*1050 display in my Thinkpad it seems that a resolution of 1366*768 would be barely adequate for reading an academic paper that has two columns in a small font. But as the original Kindle had a resolution of 600*800 and the latest Kindle has a resolution of 824*1200 [5] it seems that perhaps the epaper displays are good enough to allow reading the text at a lower resolution. A display that can draw little or no power when idling (as epaper does) is simply required for an ebook. The Pixel-Qi hybrid displays are claimed to offer the best features of TFT and epaper displays [6] but they haven t been released yet. I think it s reasonable to assume that someone will achieve that Pixel-Qi is attempting and that it will become the standard display for a Netbook. Watching movies and playing games (even games like Wesnoth) requires better video performance than epaper can deliver, we just have to hope that Pixel-Qi release something soon. Watching movies and reading ebooks are both things that are best done without a keyboard in the way. The Always Innovating Touch Book [7] seems like a good solution to this problem. It s a tablet PC that can be connected to a keyboard base if/when you desire. It should also be good for web browsing and reading email while on the move, I find that my EeePC is unreasonably heavy and awkward for typing email while walking. Intel CPUs are not particularly energy efficient. As there are ARM CPUs with clock speeds as high as 2GHz and with as many as four CPU cores it seems that the ARM architecture can provide as much CPU power as is required. Debian currently supports two versions of the ARM CPU, if another one became commonly used it wouldn t be that difficult to run Debian build servers for it. Given a screen resolution equal to the latest Kindle, CPU power greater than the early Netbooks, and the ability to run a free software OS the range of educational and gaming software should be adequate. So it seems that the ideal netbook would have a detachable keyboard and base and a touch-screen in the computer part. It would have a Pixel-Qi display (or equivalent) with a resolution of 1400*1050 or better. It would have USB, Gig-E, Wifi, and Bluetooth connectivity and the ability to have an internally mounted USB dongle (as the Always Innovating Touch Book does). I think that this is not overly difficult to achieve it is basically an Always Innovating system with a better display. Update: Another criteria is the ability to start operating quickly when requested. Even mobile phones are often limited in their utility by the time that is taken to activate them (I can t get my mobile phone to take a photo in much less than 7 seconds after removing it from my pocket). The Always Innovating system is apparently always in suspend to RAM mode when it s not being used so that it can start quickly. That combined with fast application load times and a good menu system could allow turning the system on and launching an application in less than 2 seconds. If I was buying a Netbook right now the only thing that would stop me from buying an Always Innovating device is the shipping delay. But as my EeePC is working quite well I m not going to buy another system unless I am going to get significant benefits such as a high resolution PixelQi display.

Matt Brubeck: Weekend hack: outline grep

I keep almost all of my notes and to-do lists in plain text files, so I can edit and search them with Vim, grep, and other standard Unix tools. I often indent lines in these files to create a simple outline structure, and use the autoindent and foldmethod=indent options to make Vim into a simple outliner. To get useful output when searching through these outline-structured files, I wrote a simple grep replacement. Given a text file with a Python-style indentation structure, ogrep searches the file for a regular expression. It prints matching lines, with their "parent" lines as context. For example, if input.txt looks like this:
2009-01-01
  New Year's Day!
    No work today.
    Visit with family.
2009-01-02
  Grocery store and library.
2009-01-03
  Stay home.
2009-01-04
  Back to work.
    Remember to set an alarm.
then ogrep work input.txt will produce the following output:
2009-01-01
  New Year's Day!
    No work today.
2009-01-04
  Back to work...
You can download ogrep from the outline-grep repository on GitHub, or just read the literate Haskell file. The code is almost trivial (40 lines of code, plus imports and comments); I'm publishing it just in case anyone else has a use for it, and because some of my friends were curious about how I'm using Haskell. I've now written a few "real-world" Haskell programs (compleat was the first). I'm finding Haskell very well suited to such programs, though this particular one would be equally easy in a language like Perl, Python, or Ruby. This is a one-off tool to fill a gap in my workflow; there are no configuration options or useful error messages. It would be fairly easy to extend it, though. For example, it might be handy to have an option to include children (as well as parents) of matching lines. I recently realized that ogrep often works for searching through source code too, which might generate some more unexpected use cases.

Dirk Eddelbuettel: Rcpp 0.7.2

Not even two weeks after the Rcpp 0.7.1 release, Romain and I have a new one to present: Rcpp 0.7.2. It has been uploaded to CRAN and Debian, and the respective package management systems should carry them around in the next few hours. As always, the local page is also available for download too. A lot of the momentum for the new API is continuing, thanks in large part to Romain. A number of new classes have been added, and existing ones have been enhanced. There are more unit tests than ever, and more documentation. We have better build support (with g++ version detection so that we can add some C++0x support where available) and a new examples sub-directory. We did take one toy away, though. The Doxygen-generated docs were getting so big that we decided to keep them out of the source tarball. (And arguably, they are also too volatile.) We still have the browseable html docs as well as the pdf version (now at over 300 pages!). And we added zip archives of the docs in html, latex, and man format for download. As always, full details are in the ChangeLog on the Rcpp page. Questions, comments etc: bring them to the rcpp-devel mailing list off the R-Forge page

Theodore Ts'o: Proud to be a Googler

Although I obviously had nothing to do with Google s decision vis-a-vis China, having only started working there for a week, I was definitely glad to see it and it made me proud to be able to say that I work there. Kudos to Google s management team for having made (IMHO) the right decision. Hopefully Yahoo and Microsoft will consider carefully what the ethical implications of their collusion and collaboration with the Chinese government s attempt to control free speech and the human rights implications of the same. I have my own opinion regarding the IETF s decision to meet in Beijing, since as we ve seen with the Search Engine industry s attempt to accommodate the Chinese, engagement doesn t necessarily always lead to openness and goodness. All I can suggest is that those people who do decide to travel to that meeting be very careful about what sort of message they want to send with respect to China, as well as being very careful about protecting themselves against targetted information security attacks. No related posts.

Theodore Ts'o: Proud to be a Googler

Although I obviously had nothing to do with Google s decision vis-a-vis China, having only started working there for a week, I was definitely glad to see it and it made me proud to be able to say that I work there. Kudos to Google s management team for having made (IMHO) the right decision. Hopefully Yahoo and Microsoft will consider carefully what the ethical implications of their collusion and collaboration with the Chinese government s attempt to control free speech and the human rights implications of the same. I have my own opinion regarding the IETF s decision to meet in Beijing, since as we ve seen with the Search Engine industry s attempt to accommodate the Chinese, engagement doesn t necessarily always lead to openness and goodness. All I can suggest is that those people who do decide to travel to that meeting be very careful about what sort of message they want to send with respect to China, as well as being very careful about protecting themselves against targetted information security attacks. No related posts.

12 January 2010

John Goerzen: Review: Shmoop s Coverage of Homer s Iliad

I read The Iliad recently; see my review of it here. This article isn t about The Iliad, but about Shmoop s coverage of it. I have never been a person who puts much stock on study guides before, and my own prejudice is that they have probably earned their reputation as useful for little more than a tool to help students pass exams without reading the material. However, I felt rather unequal to reading The Iliad; after all, it has been many years since I had been exposed to Greek mythology, and even then it was very brief. I had remembered from Amazon s blog that they are offering some of the classics with a Shmoop study guide built in. I figured the $2.39 would be worth it. But I m not sure it was. The resulting ebook has two sections: the main text, and the Shmoop overview. The overview contains essentially the information available for free on their site. This information is pretty good. It has some overviews of the entire book, plus summaries of each chapter. They helpfully provide the backstory in the chapter summaries, so I know why certain gods are on the side of the Trojans and the others on the side of the Achaeans. It helped me figure out the point to some of the actions described on the text. These are linked to at the beginning of each book (chapter) of the Iliad, which was a bit inconvenient because I prefer to read them after reading the main text. Nevertheless, it wasn t a big problem. The summaries were written colloquially, sometimes too much so. I grinned as the less grabbin , more stabbin summary of the Achaeans being told to salvage armor from the dead later and keep fighting now. I cringed as no way Jose , and rolled my eyes as it described how one of the heroes got owned . That would have been less clear than the original for many. I would probably have given the Shmoop edition 4 or 5 stars on Amazon were it not for numerous boneheaded mistakes they made. The commentary uses one translation (Lattimore), while the included text uses a different one (Butler). That s bad enough, but it gets worse: Lattimore uses the Greek names for the gods and heroes, while Butler uses the Roman ones. So you can be reading through the text, learning about Jove, Ulysses, Juno, and Mars. But the commentary refers instead to Zeus, Odysseus, Hera, and Ares. Now, some might have memorized the Greek and Roman names for everyone, but then such people probably aren t wanting a study guide. I finally had to print out a page to help me understand the study guide. That is terrible, and completely inexcusable. They should have used the same translation for the text as the commentary, or at least have provided parenthetical notes throughout the commentary. Next, they really did a poor job of the main text itself. They have apparently grabbed the Butler ASCII text from Project Gutenberg, and cut and pasted it into some editor. I say this because each line renders as a paragraph; that is, the text doesn t reflow to fit the screen as every single other book does. Worse, it s too wide for the Kindle. So you get one line full width, the next only half as wide as the display (some of the first having wrapped), then the next full width again, on down. Butler is a prose, not a poetic, translation, so this is pointless. Moreover, the line endings are exactly where they are at Project Gutenberg. So, what we have here is that somebody at Shmoop cut and pasted from their own website and Project Gutenberg, and nobody bothered to check if the resulting product was crap. At least with the new Kindle firmware you can read in landscape mode to prevent most of the lines from wrapping. Still, I m very annoyed at this. There are other flaws. They highlighted some passages in the text. Clicking on them goes to some commentary about it. OK, fine. But why are some passages highlighted in the text, and some mentioned in the chapter summary? There seemed no rhyme or reason. The highlighted passages commentary was iffy in quality. Sometimes it was useful, and sometimes it asked a question of the sort I might expect in a jr. high English question When has pride helped you in your life? or some such. Worse, not all of the highlights linked to the correct place, and they also suffered from the Greek/Roman name issue. In all, Shmoop has helped me understand The Iliad and place it in context. But they need to spend a lot more effort on copyediting. Even a couple of hours of someone actually looking at their Kindle product on an actual Kindle would have immediately shown these problems. They could have made a far better product with a few hours more effort.

David Welton: Rough Estimates of the Dollar Cost of Scaling Web Platforms - Part I

I have been pondering the idea behind this article for a while, and finally had a bit of time to implement it. The basic idea is this: certain platforms have higher costs in terms of memory per concurrent connection. Those translate into increased costs in dollar terms.
Nota Bene: Having run LangPop.com for some time, I'm used to people getting hot and bothered about this or that aspect of statistics that are rough in nature, so I'm going to try and address those issues from the start, with more detail below. Methodology All tests were run like so: my new laptop with two cores and four gigs of memory was used as a server, and my older laptop was used to run the ab (Apache Benchmark) program - they're connected via ethernet. I built up to successive levels of concurrency, running first 1 concurrent connection, 2, 10, and so on and so forth. The "server" computer is running Ubuntu 9.10, "karmic". Platforms The platforms I tested: As stated above, it's pretty obvious that using Rails or Django for something so simple is overkill: Better Tests for the Future I would like to run similar tests with a more realistic application, but I simply don't have the time or expertise to sit down and write a blog, say, for all of the above platforms. If I can find a few volunteers, I'd be happy to discuss some rough ideas about what those tests ought to look like. Some ideas: Results With that out of the way, I do think the results are meaningful, and reflect something of what I've seen on various platforms in the real world. First of all, here we look at the total "VSZ" (as ps puts it) or Virtual Size of the process(es) in memory. Much of this might be shared, between libraries, and "copy on write" where applicable. The results are impressive: Rails, followed by Django and PHP eats up a lot of memory for each new concurrent connection. Rails, which I know fairly well, most likely suffers from several problems: 1) it includes a lot of code. That's actually a good thing if you're building a reasonably sized app that makes use of all it has to offer. 2) Its garbage collector doesn't play well with "copy on write". Which is what "Enterprise Ruby" aims to fix. Django and PHP are also fairly large, capable platforms when compared to something small and light like mochiweb. That said, excuses aside, Erlang and Mochiweb are very impressive in how little additional memory they utilize when additional concurrent connections are thrown at them. I was also impressed with Jetty. I don't have a lot of experience with Java on the web (I work more with J2ME for mobile phones), so I expected something a bit more "bloated", which is the reputation Java has. As we'll see below, Jetty does take up a lot of initial memory, but subsequent concurrent connections appear to not take up much. Of course, this is also likely another 'apples and oranges' comparison and it would be good to utilize a complete Java framework, rather than just a tiny web app with one JSP file. So what's this mean in real world terms of dollars and cents? As your Rails application gets more popular, you're going to have to invest relatively more money to make it scale, in terms of memory. For this comparison, I utilized the bytes/dollar that I'm getting for my Linode, which works out to 18,889,040.85 ($79.95 for 1440 MB a month). As we can see, to have a similar amount of concurrent users is essentially free for Mochiweb, whereas with Rails, it has a significant cost. This information is particularly relevant when deciding how to monetize a site: with Erlang and Jetty it would appear that scaling up to lots of users is relatively cheap, so even a small amount of revenue per user per month is going to be a profit, whereas with Rails, scaling up to huge numbers of users is going to be more expensive, so revenue streams such as advertising may not be as viable. It's worth noting that 37 signals, the company that created Rails, is a vocal supporter of charging money for products. There's another interesting statistic that I wanted to include as well. The previous graph shows the average cost per additional concurrent user, but this one shows how much the platform costs (using when there is just one user, so it acts as a sort of baseline: As we can see, Jetty is particularly expensive from this point of view. The default settings (on Ubuntu) seem to indicate that, for instance, the basic $20 a month Linode package would not be sufficient to run Jetty, plus a database, plus other software. I think that the Apache Worker number is off a bit, and may reflect settings made to handle a large number of connections, or perhaps a different MPM would make sense. Source Code / Spreadsheet The spreadsheet I put together is here: http://spreadsheets.google.com/ccc?key=0An76R90VwaRodElEYjVYQXpFRmtreGV3MEtsaWYzbXc&hl=en And the source code (admittedly not terribly well organized) is here: http://github.com/davidw/marginalmemory/

Adrian von Bidder: IPv6 sucks.

I've had alias net-pf-10 off and alias ipv6 off in my configuration for ages, but with recent kernels, IPv6 is apparently compiled in, so my eth0 now has a (link local) IPv6 address. ... which means that I now had Java apps suddenly fail to connect to the database. Since stuff like sqlplus (Bah!) works, I didn't immediately think about a network problem and started testing various JVM versions and hunting missing libraries etc. Only, it turned out that running java with -Djava.net.preferIPv4Stack=true is the magic bullet. Is there a proper fix? I know IPv6 is (supposed to be) the nice and shiny future, but currently I just don't have any IPv6 connection so it just creates problems for me right now. (Ok, let's add here that I dislike Java anyway because its philosophy, or the philosophy of most software I have to deal with, is to define its own world instead of integrating nicely with the host platform. If you look at it from another direction you may think I should have titled this I suck )

John Goerzen: Sing to Me, Muse

(a review of Homer s Iliad)
Here, therefore, huge and mighty warrior though you be, here shall you die. - Homer (The Iliad)
And with that formidable quote, I begin my review of The Iliad. I shall not exhaust you with a rehashing of the plot; that you can find on Wikipedia. Nor shall I be spending page upon page of analyzing the beautiful imagery, the implications of our understanding of fate and destiny, or all the other things that compel English majors to write page after page on the topic. Nor even shall I try to decipher whether it is a piece of history or a piece of legend. Rather, I intend to talk about why I read it: it s a really good story.
Sing to me, O goddess Muse, the wrath of Achilles, son of Peleus, which brought countless ills upon the Acheans.
As I d be reading it, I d think to myself: Ah ha! Now here we finally have a section of the story that doesn t speak to modern life. Perhaps it was a section the fear of being enslaved or butchered by conquerors, or about pride leading both sides to fight a war they need not have, or a graphic description of a spear going clear through someone s head or neck. And then, I d have to sit and think. Are we really so far removed from that? Here we are, in a supposedly civilized world. We use remotely-operated drones to drop bombs on people, and think it naught but regrettable collateral damage when the brains and intestines of dozens of innocent victims are scattered about, killing them, all for the chance of killing one enemy. But we aren t the only ones to blame; we live in a world in which killing the innocent is often the goal. People fly airplanes into skyscrapers, drop atomic weapons to flatten entire cities, and kill noncombatants in terrible numbers. And for what? A little power, some prestige, some riches, some vengeance, some wounded pride? Slavery is not dead, either. We that can happily afford Internet access most likely abhor the thought. What, though, can we make of the fact that people are starving in this world in record numbers? That our actions may literally wipe some nations off the map? Are those people as free as we are? Do our actions repress them? I suspect you can t read the Iliad without being at least a bit introspective.
Fear, O Achilles, the wrath of heaven; think on your own father and have compassion upon me, who am the more pitiable
One of the great things about reading the Iliad is that I can learn about the culture of the ancient civilizations. Now, of course, one can read about this in history books and Wikipedia. But reading some dry sentence is different from reading a powerful story written by and for them. I know that the Iliad isn t exactly a work of history, but it sure shows what made people tick: their religion, their morals, their behavior, and what they valued. I feel that I finally have some sort of insight into their society, and I am glad of it.
The day that robs a child of his parents severs him from his own kind; his head is bowed, his cheeks are wet with tears, and he will go about destitute among the friends of his father, plucking one by the cloak and another by the shirt. Some one or other of these may so far pity him as to hold the cup for a moment towards him and let him moisten his lips, but he must not drink enough to wet the roof of his mouth; then one whose parents are alive will drive him from the table with blows and angry words.
There are gory battle scenes in the Iliad, but then there are also heart-wrenching tender moments: when Hector leaves his wife to go fight, for instance, and worries about the future of his child if he should die. That s not to say I found the entire story riveting. I would have liked it to be 1/3 shorter. The battle just dragged on and on. And yet, I will grant that there was some purpose served by that: it fatigued me as a reader, which perhaps gave me a small sense of the fatigue felt by the participants in the story.
Why, pray, must the Argives needs fight the Trojans? What made the son of Atreus gather the host and bring them?
A question that was never answered, for either side: why are we so foolish that we must go to war? One tragedy among many is that neither side got smart about it until way too late, if ever they did at all. I read The Illiad in the Butler translation, which overall I liked. Some of these quotes, however, use the Lattimore one. This completes the first item on my 2010 reading list. I leave you with this powerful hope for the future, written almost three thousand years ago. Despite my criticisms above, we have made a lot of progress, haven t we? What a beautiful ideal it is, and what a long ways we have yet to walk.
I wish that strife would vanish away from among gods and mortals, and gall, which makes a man grow angry for all his great mind, that gall of anger that swarms like smoke inside of a man s heart and becomes a thing sweeter to him by far than the dripping of honey.
Sing to me, O goddess, the anger of Achilles, that one day his story may speak less to our hearts, for then will we have outgrown it.

11 January 2010

Robert Millan: GRUB gets new face


My friend Jo Shields added the missing piece by writing the first theme that fit the basic requirements (uses only legal & free fonts and images with no external dependencies), and now GRUB gets a new face! This is just one of the ton of possibilities our new graphical menu framework was designed for. If you want to try it out, grub-pc 1.98~experimental.20100111.1-1 has just been uploaded to Debian/experimental. For non-Debian systems, Jo s blog post provides a standalone tarball which can be used with GRUB Experimental branch in Bazaar. Many thanks to everyone who made this possible, including Jo, Colin for developing the gfxmenu framework and Vladimir for his extensive work reviewing and polishing it. Now for the obvious question (before anyone asks): when is this reaching mainstream? Well, there s lots of code being added, and keep in mind GRUB is a bootloader and it must not compromise on its main feature (being able to boot!), so we need a pack of brave souls to try out the code, find bugs and report them. Once we re reasonably sure the new code is mature, it ll find its way to GRUB trunk and eventually GRUB 1.98. So you can help us out! Install it; spread the news; make your desktop a bit nicer and come to us if you find that something went terribly wrong ;-)

Riccardo Setti: news about me

It's a long time that i think to resign from Debian/Ubuntu. In fact i stopped the active development years ago.
I kept on following people and development in general, but i dind't produce anything new/cool.

The strange thing is that everytime i changed work one of my primary assigment was port all custom
software needed at installation time from stupid_install.script to common useful debian package.

I don't even know why i never fill an ITP, and/or find someone who want care about $package and give
my work to him (or maybe share it in a public place). i'm definetly lazy.

This time was the same. Changed job in october and (as said before) i had to create some
custom debian package.

So now that the Cascaad is out i can give away some of my debian related work.

If you care about:
solr
activemq
mcollective
mule
feel free to contanct me at giskard _ at _ debian.org OR giskard _at_ ubuntu.com .
i will be happy to give to you my debian/ and discuss where you can improve the package.

Next.

Previous.