Search Results: "ag"

2 May 2008

Gerfried Fuchs: Deja Vu?

Sometimes strange things happen. This tuesday I had been to a simply great concert again: Grossstadtgeflüster. They were wearing nice white jumpsuits with finger-color handprints on them, the playlist was mostly really great, good mix of their first and from the great new album. But what was the most interesting part is that they announced another concert on the following tuesday. I just dropped to the floor because well, yet another of those "coincidences", because well, next tuesday is my birthday. Again. Deja Vu, anyone? On wednesday I had been to the next concert: Mono & Nikitaman. I never have seen the WUK that crowded, the hall was totally packed, people were even standing through the doors into the pre-hall. And even though they are rooted in Reggae it was in no way slow or soft. Greatly carrying along, hard to keep ones feet still. Only drawback when having two great concerts in two subsequent nights: Your neck and back starts to hurt and requests its toll. *ouch*

David Moreno Garza: Blog Normalize on The Perl Foundation

So I wrote an entry on my tumblelog about what s going on with my life currently. Since Tumblr s feed doesn t get pushed immediately, I showed the post to my co-worker and friend Chris, before it hit the planets: - So, yeah I have my blog since it s syndicated on Planet Debian and other small feed aggregators -I said. - But do they really care about your bike, your chess games or you attending that conference? -he asked-, I mean, I do care, but people? - Well -I replied after a quick thought-, I think that s how personal blogs work. After a deeper thought I just realized that indeed no one cares and deleted the entry before it was pushed to the feed, updating it on FeedBurner, etc. It was a nice awakening.
But on a bit more interesting (for people) things, The Perl Foundation is currently requesting comments on the projects they received for grant requests. My proposal is there, Solidifying and Extending the Blog Normalize project . I do think there are some other more deeper projects, of course, but I think B::N is also an interesting one and the amount requested is not as big for other projects, so it d be nice to give it a try. I believe B::N is a good idea that could be enhanced nicely. I proposed the idea to the TextMotion developers yesterday on IRC (since that s one of the CMS there would be a connector for -as of the grant proposal-). After deeper discussion, CMSs will not make translators for a lot of projects into theirs, but B::N would, so maybe we could make some sort of webservice that CMSs could call on their installation phases. That, or the user at the end could actually do the conversion himself locally. Having the proper information, one could be able to get from TextMotion to Wordpress, to Blogger, to Joomla, to Tumblr, to MovableType and to TextMotion again, making a transparent circular transformation. Some of this is currently possible with the few code I ve written for it, currently in CPAN (and a bit deeper proof of concept); if you are interested, please leave your comments on the Perl Foundation blog entry. And review others too. At the end, I might end up doing the project myself, but if some money is granted to do so, why not apply to it, that d just speed it up.

Russell Coker: The Future of Xen

I’m currently in Xen hell. My Thinkpad (which I won’t replace any time soon) has a Pentium-M CPU without PAE support. I think that Debian might re-introduce Xen support for CPUs without PAE in Lenny, but at the moment I have the choice of running without Xen or running an ancient kernel on my laptop. Due to this I’ve removed Xen from my laptop (I’m doing most of my development which needs Xen on servers anyway). Now I’ve just replaced my main home server. It was a Pentium-D 2.8GHz machine with 1.5G of RAM and a couple of 300G SATA disks in a RAID-1. Now it’s a Pentium E2160 1.8Ghz machine with 3G of RAM with the same disks. Incidentally Intel suck badly, they are producing CPUs with names that have no meaning, and most of their chipsets don’t support more than 4G of physical address space [1]. I wanted 4G of RAM but the machine I was offered only supported addressing 4G and 700M of that was used for PCI devices. For computation tasks it’s about the same speed as the old Pentium-D, but it has faster RAM access, more RAM, uses less power, and makes less noise. If I was going to a shop to buy something I probably would have chosen something different to get support for more than 4G of RAM, but as I got the replacement machine for free as a favor I’m not complaining! I expected that I could just install the new server and have things just work. There were some minor issues such as configuring X for the different video hardware (and installing the 915resolution package (which is only needed in Etch) to get the desired 1650×1400 resolution. But for the core server tasks I expected that I could just move the hard drives across and have it work. After the initial install the system crashed whenever I did any serious hard drive access from Dom0, the Dom0 kernel Oopsed and network access was cut off from the DomU’s (I’m not sure whether the DomU’s died but without any way of accessing them it doesn’t really matter much). As a test I installed the version of the Xen hypervisor from Unstable and it worked. But the Xen hypervisor from Unstable required the Xen tools from Unstable which also required the latest libc6, and therefore the entire Dom0 had to be upgraded. Then in an unfortunate accident unrelated to Xen (cryptsetup in Debian/Unstable warns you if you try to use a non-LUKS option on a device which has been used for LUKS and would have saved me) I lost the root filesystem before I finished the upgrade. So I did a fresh install of Debian/Unstable, this time it didn’t crash on heavy disk IO, instead it would lock up randomly when under no load. I’ve now booted a non-Xen kernel and it’s working well. But this situation is not acceptable long-term, a large part of the purpose of the machine is to run virtualisation so that I can test various programs under multiple distributions. I think that I will have to try some other virtualisation technologies. The idea of running KVM on real servers (ones that serve data to the Internet) doesn’t thrill me, Tavis Ormandy’s paper about potential ways of exploiting virtual machine technologies [2] is a compelling argument for para-virtualisation. Fortunately however my old Pentium-3 machines running Xen seem quite reliable (replacing both software and hardware is a lot of pain that I don’t want). In the near future I will rename the Xen category on my blog to Virtualisation. For older machines Xen is still working reasonably well, but for all new machines I expect that I will have to use something else - and I’ll be blogging about the new machines not the old. I expect that an increasing number of people will be moving away from Xen in the near future. It doesn’t seem to have the potential to give systems that are reliable when running on common hardware. Ulrich Drepper doesn’t have a high opinion of Xen [3], the more I learn about it the more I agree with Ulrich.

Simon Richter: PDFs: doing it wrong

John writes about PDFs and the problem of embedded fonts that are missing due to restrictive licencing. Font designers usually distinguish between "embedding" and "using" a font, prohibiting the former in their licence agreement. The difference is that when a font is "used", all information about the text is lost, and only rendering instructions remain (usually a set of Bezier curves). PDF allows you to annotate a rendered page in various ways, among other things, it allows you to specify that a certain region should be interpreted as a specific text. For example, OCR tools working with PDF files start with a file containing just the image data, and add the textual information, so you end up with a file that looks like the scan, but has selectable text. While that is certainly not legal advice, so far it has been considered acceptable to ship a PDF file with pre-rendered text and an annotation that facilitates copy&paste (which you also need with embedded fonts to allow selections to see ligatures like " " as two distinct characters). These files may be slightly larger than they would be with an embedded font, but have the advantage of looking exactly the same everywhere and at the same time, being trivial to render as the rasterizer does not need to understand anything about text layout. tl;dr: if you have a document that people should be able to see exactly the way you intended it, please include the text curves if you may not embed the font directly, and provide selection hints.

Simon Richter: .deb versus .msi

I've learnt a lot about building MSI files during the last days. In a way, it is very similar to building Debian packages -- you hand some magic tool a directory with files and a directory with meta-information. The main difference is that MSI files cannot call arbitrary commands in their installation sequence, which serves an useful purpose: as long as they make do with the standard actions provided with the base installer, it is guaranteed that you can undo all changes, and you can get a full overview what the installation will do, without running any untrusted code. If the standard actions aren't enough (for example, they don't cover driver installation), you can ship a DLL that can be loaded into the installer. You lose a bit of the audit functionality there, but that is not a problem in practice as these plug-ins are signed separately from the package, so for every genuine problem, there is already a plug-in that you can simply "merge" to your package.

Andreas Metzler: dist-upgrading to perl 5.10

On sid dist-upgrading requires some handholding currently: (SID)root@argenau:/# DEBIAN_FRONTEND=noninteractive apt-get --purge dist-upgrade
[...]
Calculating upgrade... Failed
The following packages have unmet dependencies:
e2fsprogs: PreDepends: libuuid1 (>= 1.34-1) but it is not going to be installed
mount: PreDepends: libuuid1 but it is not going to be installed
E: Error, pkgProblemResolver::Resolve generated breaks, this may be caused by held packages.
The reason is the recently started upgrade to perl 5.10. This makes many packages temporarily uninstallable, (including lintian) but perhaps you need to upgrade to perl-5.10 now nevertheless. apt seems to stumble over debconf-i18n,
apt-get --purge install debconf-english
lets dist-upgrade succeed.

1 May 2008

John Goerzen: DjVu and the scourge of the PDF

A little while back, I wrote a blog post called DjVu: Almost Awesome, where I pointed out the strengths of the three DjVu family of formats, but lamented the fact that there was no Free Software to create DjVu files in the most interesting format, DjVu Document.

Well, now there is: pdf2djvu is out and works, and it's been ITP'd to Debian, too.

As a very quick recap, DjVu is a family of raster image codecs that often creates files much smaller than PDFs, PNGs, TIFFs, etc. It has a ton of advanced features for things like partial downloads from websites. It's pretty amazing that a raster format can create smaller files than PDFs, even at 300 or 600dpi resolutions in the output. Of course, for some ultra-high-end press work, PDF would still be needed, but DjVu is quite compelling for quite a few uses. Since it is a raster format, it is simpler to decode and is not subject to local system variations, such as installed fonts, like PDF is.

Which brings me to the scourge of PDF. Recently we got a trouble ticket at work from someone saying there was a bug with our Linux environment because Linux users didn't see the correct results when they opened his PDF file. A quick inspection with some of the xpdf utilities (pdffonts, to be specific) revealed that the correct fonts were not embedded in the file. The user didn't believe me, and still wanted to blame Linux, saying that it worked fine on his PC with Acrobat. So I tried opening the file on a Windows 2003 terminal server, and it looked worse there than it did with any Free Linux viewer -- really quite terribly corrupted. He still wasn't entirely convinced, until he happened to try printing the file in question, and even Acrobat couldn't print it right.

PDF was supposed to be a "read anywhere" format that produces exact results. But it hasn't really lived up to that. Font embedding is one reason; the spec lists a handful of fonts that are allowed to not be embedded, but it is routine for some reason to violate that and fail to embed quite a few more. Then you have to deal with font substitution on the receiving end, which is inexact at best. Then you have all sorts of complex differences between versions, and it becomes quite the mess. (And don't even get me started on broken PDF editors, such as the ones Adobe sells...) Somehow, quite a few people seem to have this idea built up in their heads that PDF is both an exact format, and an editable format, when really it is neither. (Last week, I was asked to convert a PDF file to a Word document. Argh.)

DjVu keeps looking more and more pleasant to my eyes.

Pablo Lorenzzoni: "Important by Association"

Here is a story people are bugging me to tell here: Since 2003, every year in fisl s last day we, Debian Brasil, hold a party to celebrate Debian s anniversary (I know it s on August, but it s probably the only opportunity we ll have to gather all the gang together so we do it in advance anyway). It s always something that draws everybody s attention in the conference I wonder if the pieces of cake we distribute have anything to do with it Anyway, this anecdote happened during fisl9.0 s party. I was there, helping by distributing cake and blowing our whistles when Jon Maddog Hall got there to check what s going on. I met Jon around 2001, in OpenBeach, an event that happens in Florian polis every year (and that Jon likes to attend)... he s the most pleasant guy, with lots of stories to tell. Since this years fisl was so intense, I barely had time to talk to him in fact, that was the first time we saw each other this year. We hug each other and were asking how s each other life s going and so, when Jon got his camera out of his pocket and asked some guy in the crowd to get our picture. I did the same. We exchanged some compliments and he left saying that he still had to work in his talk. Jon is quite a character. In fisl, every time he wanders around his picture is taken over one hundred times (I actually saw some father taking pictures of him holding his child like he were running for Senate or something, one time). So he left with some people around him and I think he d not seen what happened next. I turn towards Debian s booth, to resume the cake delivery when some guy in the crowd asked me to take a picture with him. And then another one and another. I believe my picture was taken another two or three times before I got to the booth. I can t believe! I was about to tell people Hey! I am nobody! Stop taking pictures with me What were they thinking? I imagine something like I don t know who this guy is, but if Maddog took a picture with him, he must be some one! was crossing their minds. When the party was over I went back to the Organization Committee room and told this story LTSP s Jim McQuillan (another good friend) told me I was Important by Association , and everybody just kept laughing at me because of that. I haven t got the time to tell Jon about it I hope he s reading. I think I am going to check what pictures people are uploading about fisl, to see if I can find myself on any ;-)

Lior Kaplan: Firefox triage has ended - 300+ bugs processed


It took half a year (including a long pause), and the Firefox triage is finally over. The last part, reviewing 120 bug reports took about a month. Starting with 324 bugs, the triage ended with 10 open bugs which I left for the maintainer to handle himself. Although I didn’t keep record about the exact numbers about how many bugs were found to be fixed, it seems that ~250 bugs were closed (fixed, not relevant any more, whatever…). This leaves ~70 bugs to be valid (all reassigned to Iceweasel and got the right version info). As I see it, the biggest problem of the large package maintainers have is to figure out if the bug is Debian specific or upstream only. The latter should be reported upstream by the users (when possible) to lower the pressure on the maintainers. I my recent triages I saw a lot of upstream only bugs reported only in Debian, since the maintainers can’t be just “bugs forwarders”. It might work well in small packages, but this doesn’t scale up. So when possible, please try and report bugs upstream… Anyway, I’ll probably initiate another triage for Iceweasel when version 3.0 will enter testing (probably post Lenny).

Randall Donald: New Team Member

I'm pleased to announce Lennart Sorensen has joined the Debian NVIDIA Maintainers packaging team.
His first focus might be with the linux-modules-nonfree-2.6 integration as well as the current support he already does. Thanks and welcome Len.

Gunnar Wolf: Would you mind a quick ride?

May 1st is a holiday in many countries around the world - It is, at least, here in Mexico. So, what's a man to do when faced with really-crappy network connectivity at home?
Yesterday I had dinner with Gigio, and among many other things, we talked about the Ciclot n, which I've only done twice. And on my way back home, I crossed (twice) the path of a group of ~100 cyclist going over Colonia Roma.
Anyway, whatever the reason, I woke up very well in the mood for a nice 20km ride:

Now, lets get the day started!
[update] I was told about a worldwide nudist cycling activity, the World Naked Bike Ride. Their page states their main motivator:
We face automobile traffic with our naked bodies as the best way of defending our dignit and exposing the unique dangers faced by cyclists and pedestrians as well as the negative consequences we all face due to dependence on oil, and other forms of non-renewable energy.
Of course, Mexican groups take part in this interesting activity - Ciclomarcha nudista.
Will I be there? I don't know - Quite probably, yes. I first thought of it as a joke, and as a dangerous activity. But, come think of it, I am a move-by-bicycle-in-the-largest-city-in-the-world activist. I have been knocked over or shit-scared (and fortunately not more than that) by careless drivers, but than won't force me back into driving my car when not needed. And this kind of activities, which do get their good share of exposure, need all the participants - I hope to be there, June 7 12:00PM, at the beginning of Mexico City Ciclopista (FFCC de Cuernavaca esq. Ej rcito nacional, Polanco) Chapultepec's Lions' entrance, at the crossing of Lieja and Reforma.

Share the awareness. There are very good promotional pictures. And collective nudist activities are quite fun, experiences to remember for life.

Chris Lawrence: Letting go of my baby

I just added two new developers to the reportbug project on Alioth, Sandro Tosi and Y Giridhar Appaji Nag, who seem to be enthusiastic about working through the big backlog of bug reports and wishlist requests associated with the package. Since my Debian-related interests are largely elsewhere these days, mostly focused on R stuff that has a more tangible relationship with my research (and by extension my future job mobility and/or tenurability) and a few other infrastructural things in Debian (primarily LSB support and printing), I think this is a good development overall. But still, when you’ve been hacking away at something for almost nine years it’s hard not to develop a bit of a sentimental attachment to it. I still plan to be doing some hacking away at reportbug, but hopefully the new blood can take the lead in terms of day-to-day maintenance while I work on some of the desperately-needed code refactoring issues with the software.

Enrico Zini: Audit your debian uploads

Audit your debian uploads My bank is sending me an e-mail every time I log into the home banking system, so that I can spot malicious logins. My credit card is sending me a SMS message every time it gets charged, so that I can spot mailicious charges. Can I get a notification of every Debian upload done with my key, so that I can spot if my key has been stolen? Let's work on that. As a start, thanks to Ganneff, here is how to do a one-off audit:
# go to merkel to access projectb, which is the postgresql database
# with all dak information
$ ssh merkel
merkel$ psql projectb
# look up the database id of my fingerprint
projectb=> select id, fingerprint from fingerprint where fingerprint like '%797EBFAB';
 id                  fingerprint                
    -----+------------------------------------------
     394   66B4DFB68CB24EBBD8650BC4F4B4B0CC797EBFAB
    (1 row)
# get a list of all uploads done with my key, sorted by date
projectb=> select * from source where sig_fpr=394 order by install_date desc;

First you get to do it (done); then you document it (done); then you automate it. It's quite trivial at this point, so enjoy the new Debian upload monitor. It's got search as you type to find your full fingerprint, then you get an HTML page with the log of your uploads in the last 2 months, and the page has an RSS feed that you can use to track your own uploads. Also, generating all this static content is acceptably fast:
merkel$ time ./deb-key-audit 
real    0m7.145s
user    0m4.244s
sys 0m0.384s

If you want to see the code, you can git clone http://merkel.debian.org/~enrico/keylog.git Currently it wrongly encodes UTF-8 characters: I suppose the strings come out of the database as ASCII instead of UTF-8. A patch would be welcome to fix that. I will now contact QA to see what we can do with it; if it ends up fitting in some bigger picture then it may be that the RSS links will change, but I'll post about it in that case.

Kartik Mistry: Today


* Up late at 11 am. Chewed some mails and feeds. Searched for ATM nearby. Nothing found, Lunch ended up biscuits and dosa/idali. * Noon nap. Built kdelibs first time (2nd try, still going on). Built latest LDTP and uploaded to mentors. Waiting for dinner. Called Ks and home at eve.

Steve Kemp: Fight in the shade

Tonight I'm going to enjoy a nice long sleep after attending The Beltane Fire Festival yesterday evening. I did manage to sort out an SSL certificate yesterday, before I went out. A lengthier process than expected because the SSL-registrar was annoying and mailed the admin address listed in whois for my domain; rather than an address upon the domain itself. I guess they can't be blamed for that, and the registrar did forward on the request when begged, so it wasn't the end of the world. For reference I used godaddy.com; who sold me a 3 year SSL certificate for about £25. Today I've been mostly catatonic because I had only two hours sleep last night. But one good piece of news was receiving a (postal) mail from Runa in response to the letter I had sent her some time ago. ObQuote: 300

Axel Beckert: Dilbert.com became even more better

nion argued about the new Dilbert.com website now using flash instead of GIFs and I responded that it’s not as bad since Dilbert.com now also officially offers RSS feeds — without Flash. It looks as if Scott Adams got more responses from nion type people since he divides the feedback to the new Dilbert.com site into three groups: Those who are angry about flash and bloat (mostly techies and linuxers), those who are fine with the design and features, but angry about the slowness due to overload and those who are fine with the design and features and ignore the speed. I’m in none of these groups. But Scott Adams valued the feedback and responded especially to the first two groups of critics with something for which he couldn’t have found a better URL:

http://dilbert.com/fast With this pure Dilbert, nion should now be happy again. I still prefer the RSS feeds though.

Joerg Jaspert: Splitting huge mbox files

As I just had the need to split up two huge mbox files by date and did not find a tool that does that easily, I thought I share what I used. Careful, it isn’t very clever, so if you use it: It comes with NO WARRANTY at all. If it eats your mail, you lost. Not my fault, you have been warned. The task it should solve reads There are various ways to do it, one would be to use mutt, with something similar to the following in a muttrc file somewhere
 unset confirmcreate
 set delete=yes
 set folder=/dev/null
and then a lot of lines looking similar to the following, just replacing the dates;
folder-hook . 'push "T~d01/03/2008-31/03/2008\n;s2008-03.mbox\n$%q"'
If you then start mutt using mutt -F theabovemuttrc -f themboxfiletosplit it will go and split it into the YEAR-MONTH based files. I got this way from Gerfried Fuchs, as I am no mutt user and wouldn’t have found the way to do it with mutt myself. Drawback: Mutt needs exact date entries in the push lines. Means you have to write 29/02 if you mean “last day of Februar”, a plain stupid 31/02 will be converted to 02/03. And I was way too lazy to list all the dates for the timeframe those mboxes cover. So, other solution. Ruby to the rescue! The following code does split the mbox into the files I want, based on the date header:
#!/usr/bin/ruby -w
# Split a mbox file into $year-$month files
# Copyright (C) 2008 Joerg Jaspert 
# BSD style license, on Debian see /usr/share/common-licenses/BSD
require 'pathname'
require 'rmail'
count = 0
File.open(Pathname.new(ARGV[0]), 'r') do  mbox 
  RMail::Mailbox.parse_mbox(mbox) do  raw 
    count += 1
    print "# count  mails\n"
    begin
      File.open(RMail::Parser.read(raw).header.date.strftime("split/mail-%y%m"), 'a') do  out 
        out.print(raw)
      end
    rescue NoMethodError
      print "Couldn't parse date header, ignoring broken spam mail\n"
    end
  end
end
This will go through the whole mbox and store them in split/mail-$year$ month files. It has a few things you should keep in mind, if you really want to use it: The above script took, niced down with nice -15 on an otherwise used server, about 25 minutes to split around one million mails from the above mentioned large files, with no noticable memory usage (only one mail at a time in memory). Comments: 5

Vincent Fourmond: PDF conversion to grayscale

I had some trouble finding out how to convert a color PDF to a grayscale one. I found a post on an Ubuntu forum giving the following recipe:
pdf2ps -sDEVICE=psgray original.odf
ps2pdf original.ps new.pdf
This works, but this has the unpleasant side effect to increase the size of the PDF and to lower the quality (for a reason which escapes me). So I looked again in the magic pdfwrite parameters, and I came up with the following solution, which works on my box (though the above page suggests it shouldn't):
gs -sOutputFile=biniou.pdf -sDEVICE=pdfwrite \
  -sColorConversionStrategy=Gray -dProcessColorModel=/DeviceGray \
  -dCompatibilityLevel=1.4 Plot.pdf  /dev/null
This works fine, does not lower the quality of the produced PDF and in the case I tried even made it smaller...

Matthew Palmer: Architecture Astronauts

I really don't think I have anything to add to Joel Spolsky's latest essay, on the horror of architecture astronauts. My favourite quote:
It sort of bothers me, intellectually, that there are these people running around acting like they're building the next great thing who keep serving us the same exact TV dinner that I didn't want on Sunday night, and I didn't want it when you tried to serve it again Monday night, and you crunched it up and mixed in some cheese and I didn't eat that Tuesday night, and here it is Wednesday and you've rebuilt the whole goddamn TV dinner industry from the ground up and you're giving me 1955 salisbury steak that I just DON'T WANT. What is it going to take for you to get the message that customers don't want the things that architecture astronauts just love to build.

30 April 2008

Uwe Hermann: Redirecting audio to a remote host using esddsp

There are situations where you might want to redirect some audio you're playing on your local computer to another computer's speakers, potentially in a different room, or even anywhere on the Internet. One of many possibilities to do that is to use the Enlightened Sound Daemon (EsoundD, or esd). It ships with a program called esddsp (apt-get install esound-clients) which can redirect various audio sources. First, you have to start the esd daemon on a console on the remote host (the one which should output the audio on some speaker, for example 192.168.0.xxx) e.g. like this:
  $ esd -public -nobeeps -tcp
You can do this as regular user (no need to be root) if you have the proper permissions. You also need to allow connections on port 16001 in your firewall settings. Then you can redirect audio to that daemon from another computer. In this example I'm redirecting some music using various players:
  $ esddsp -s 192.168.0.xxx:16001 mpg321 -o esd foo.mp3
  $ esddsp -s 192.168.0.xxx:16001 mplayer -ao esd foo.mp3
  $ esddsp -s 192.168.0.xxx:16001 ogg123 -d esd foo.ogg
This also works fine for videos, in which case you can redirect the audio (but not video):
  $ esddsp -s 192.168.0.xxx:16001 mplayer -ao esd foo.mp4
For the video player Miro, I've recently documented this in the Debian package's README.Debian file. Basically you have to edit ~/.xine/config and enable audio.driver:esd there, then start Miro with
  $ esddsp -s 192.168.0.xxx:16001 miro
Audio will be emitted on the remote host, video remains on your local PC. Some programs may also support esd natively, in which case esddsp is not required, e.g.
  $ ogg123 -d esd -o host:192.168.0.14:16001 foo.ogg

Next.

Previous.