Search Results: "ed"

2 November 2010

Enrico Zini: Using the apt-xapian-index catalogedtime plugin

Using the apt-xapian-index catalogedtime plugin apt-xapian-index has recently gained a catalogedtime plugin, which stores the timestamp of when the package was first cataloged. At first glance this does not mean much, so I'll explain with an example. aptitude can show a list of "New Packages": those packages that it sees now for the first time. It is a very useful feature, but you cannot ask it "what packages became available during last week?" With the catalogedtime plugin, the apt xapian index can now answer that question. You can also sort package results by "newness", or implement a user interface with some sort of "newness timeline" package filter option. Of course you will find documentation about it in /var/lib/apt-xapian-index/README, since the index is self-documenting. As usual in my apt-xapian-index posts, here is a code example:
#!/usr/bin/python
# coding: utf-8
# Show packages that were NEW in the last N days
# (C) 2010 Enrico Zini <enrico@enricozini.org>
# License: WTFPL version 2 (http://sam.zoy.org/wtfpl/)
import axi
import xapian
import time
import sys
class App:
    def __init__(self, days):
        self.db = xapian.Database(axi.XAPIANINDEX)
        # Read the contents of /var/lib/apt-xapian-index/values
        self.values, self.descs = axi.readValueDB()
        # Find the value ID for the catalogedtime timestamps
        self.cattime_vid = self.values["catalogedtime"]
        # Filter packages first seen more than than X days ago
        self.query = xapian.Query(xapian.Query.OP_VALUE_GE, self.cattime_vid,
                    xapian.sortable_serialise(time.time() - 86400*days))
    def main(self):
        # Perform the query
        self.enquire = xapian.Enquire(self.db)
        self.enquire.set_query(self.query)
        # Sort by cataloged time
        self.enquire.set_sort_by_value(self.cattime_vid, True)
        # Print the first 200
        matches = self.enquire.get_mset(0, 200)
        for m in matches:
            name = m.document.get_data()
            val = m.document.get_value(self.cattime_vid)
            fval = xapian.sortable_unserialise(val)
            tm = time.localtime(fval)
            timestr = time.strftime("%c", tm)
            print "%s %s" % (timestr, name)
if __name__ == "__main__":
    try:
        days = int(sys.argv[1])
    except:
        print >>sys.stderr, "Usage: %s days" % sys.argv[0]
        sys.exit(1)
    app = App(days)
    app.main()
    sys.exit(0)
Enjoy!

Julien Danjou: Transparent GIF support in Emacs 24

Last week, I wrote a couple of patches to add support for transparency when Emacs is displaying GIF images. Until now, it was displaying the color used to define transparency in the file data. Now it displays the image correctly by using the frame color as the transparency color, like it's done for other image formats. The patches have not been merged yet, but will probably be soon. Flattr this

Francois Marier: RAID1 alternative for SSD drives

I recently added a solid-state drive to my desktop computer to take advantage of the performance boost rumored to come with these drives. For reliability reasons, I've always tried to use software RAID1 to avoid having to reinstall my machine from backups should a hard drive fail. While this strategy is fairly cheap with regular hard drives, it's not really workable with SSD drives which are still an order of magnitude more expensive.

The strategy I settled on is this one:This setup has the benefit of using a very small SSD to speed up the main partition while keeping all important data on the larger mirrored drives.

Resetting the SSDThe first thing I did, given that I purchased a second-hand drive, was to completely erase the drive and mark all sectors as empty using an ATA secure erase. Because SSDs have a tendency to get slower as data is added to them, it is necessary to clear the drive in a way that will let the controller know that every byte is now free to be used again.

There is a lot of advice on the web on how to do this and many tutorials refer to an old piece of software called Secure Erase. There is a much better solution on Linux: issuing the commands directly using hdparm.

Partitioning the SSDOnce the drive is empty, it's time to create partitions on it. I'm not sure how important it is to align the partitions to the SSD erase block size on newer drives, but I decided to follow Ted Ts'o's instructions anyways.

Another thing I did is leave 20% of the drive unpartitioned. I've often read that SSDs are faster the more free space they have so I figured that limiting myself to 80% of the drive should help the drive maintain its peak performance over time. In fact, I've heard that extra unused unpartitionable space is one of the main differences between the value and extreme series of Intel SSDs. I'd love to see an official confirmation of this from Intel of course!

Keeping the RAID1 array in sync with the SSDOnce I added the solid-state drive to my computer and copied my root partition on it, I adjusted my fstab and grub settings to boot from that drive. I also setup the following cron job (running twice daily) to keep a copy of my root partition on the old RAID1 drives (mounted on /mnt):
nice ionice -c3 rsync -aHx --delete --exclude=/proc/* --exclude=/sys/* --exclude=/tmp/* --exclude=/home/* --exclude=/mnt/* --exclude=/lost+found/* --exclude=/data/* /* /mnt/

Tuning the SSDFinally, after reading this excellent LWN article, I decided to tune the SSD drive (/dev/sda) by adjusting three things:


Is there anything else I should be doing to make sure I get the most out of my SSD?

Tollef Fog Heen: Temperature logging with 1-wire

Last night, I finally got my temperature sensors going, including a nice and shiny munin plugin giving me pretty graphs. So far, I only have a sensor in the loft, but I'll spend some days putting sensors in the rest of the house as well. Robert McQueen asked me on twitter how this all was set up, so I figured I'd blog about it. The sensors I'm using are the DS18B20 ones from Dallas Semiconductor. You can probably buy them from your local electronics supplier, but mine charges around 75 NOK a piece, so I just bought some off Ebay. It takes a bit longer, but I paid about 1/10th the price. For logging, I'm using my NAS, which is just a machine running Debian, an USB to serial adapter and an serial-to-1-wire adapter. Thanks a lot to Martin Bergek for the writeup and the ELFA part numbers for diodes. Since I'm lazy, I ended up just writing a plugin for munin. It uses owfs, which I downloaded from mentors.debian.net. I also offered sponsorship for it, assuming a few small issues are cleaned up, so hopefully you can install using just Debian in the near future. owfs is fairly easy to work with, and the plugin uses the aliased names if you provide aliases, so you can know what the temperature in a given location is, rather than having to remember 64 bit serial numbers.

Theodore Ts'o: I have the money shot for my LCA presentation


Thanks to Eric Whitney s benchmarking results, I have my money shot for my upcoming 2011 LCA talk in Brisbane, which will be about how to improve scalability in the Linux kernel, using the case study of the work that I did to improve scalability via a series of scalability patches that were developed during 2.6.34, 2.6.35, and 2.6.36 (and went into the the kernel during subsequent merge window). These benchmarks were done on a 48-core AMD system (8 sockets, 6 cores/socket) using a 24 SAS-disk hardware RAID array. Which is the sort of system which XFS has traditionally shined on, and for which ext3 has traditionally not scaled very well at. We re now within striking distance of XFS, and there s more improvements to ext4 which I have planned that should help its performance even further. This is the kind of performance improvement that I m totally psyched to see! No related posts.

Theodore Ts'o: I have the money shot for my LCA presentation


Thanks to Eric Whitney s benchmarking results, I have my money shot for my upcoming 2011 LCA talk in Brisbane, which will be about how to improve scalability in the Linux kernel, using the case study of the work that I did to improve scalability via a series of scalability patches that were developed during 2.6.34, 2.6.35, and 2.6.36 (and went into the kernel during subsequent merge window). These benchmarks were done on a 48-core AMD system (8 sockets, 6 cores/socket) using a 24 SAS-disk hardware RAID array. Which is the sort of system which XFS has traditionally shined on, and for which ext3 has traditionally not scaled very well at. We re now within striking distance of XFS, and there s more improvements to ext4 which I have planned that should help its performance even further. This is the kind of performance improvement that I m totally psyched to see! No related posts.

1 November 2010

Maximilian Attems: "We'll Always Have Paris" linux-2.6

At the mini-DebConf Paris 2010 the Debian linux-2.6 team released latest 2.6.32-27 adding stable 2.6.32.25 plus security fixes and drm/intel fixes from the Ubuntu shared drm 2.6.33 tree. Beside the productive Debian kernel team meeting, whose minutes will be forthcoming, the mini Debconf had a great welcoming setup and friendly chats. We enjoyed an impulsive Saturday evening at Chatelet in middle of the funny Parisian Halloween mess.
Update: Photo of the last busy meeting session during lunch break that allowed us to finalise all Paris meeting topics.

John Goerzen: Some Amateur Radio Statistics

I ve had a lot of fun with amateur radio since I got licensed in July! Here are some numbers regarding my HF contacts. Not included in this are probably hundreds of more contacts on VHF or UHF, which are more local bands and not typically logged. One of my favorite moments happened recently when I turned on my digital program (fldigi) and happened to tune to 17m. I don t have antennas there and don t usually bother, since there s rarely something I can receive. But I saw two PSK-31 (digital) signals. One of them was a Japenese station calling CQ. I replied, and although we had some noise (perhaps due to my lack of a 17m antenna), made my first contact with Japan! Things like this are part of the fun of amateur radio. Sometimes things that have no business working actually do, and I get a surprise like this.

Biella Coleman: The Anthropology of Hackers

I meant to blog about this a long time ago but it slipped past me. Here is my course on hackers described in The Atlantic . I ma not teaching it this year but will do so next year. I actually include a lot more than what is in the syllabus (much to the chagrin of my students).

Tim Retout: Boxes

Today I bought two Ikea boxes. Possibly the best 8 I have ever spent - I still have a load of bits of paper to sort out, but now they're all hidden from sight in a sleek, black and chrome rivet-effect container. More than simply reclaiming my sofa from the piles of notes, they seem to point to a higher truth; they fit their purpose in a way that is hard to articulate, like some platonic Form. Taking complexity, and making it manageable; but more than that, elegant. At some point, I lost the ability to explain to my friends and family what it is I spend my spare time doing. I feel isolated; I cannot express what motivates me, or even what it is I do. In fact, sometimes I can't even describe it to myself. Perhaps I never could. I don't believe that you can buy happiness; but if I surround myself with metaphors, maybe I can buy clarity.

Ben Hutchings: RCBW(eekend) 2010-11-01

Julien Valroff: Mini DebConf Paris 2010

I am now back home after 2 days spent at the first mini DebConf Paris. It was really nice to meet a lot of people, and to be able to discuss various aspects of Debian and Free Software in general. People came from all over Europe (at least from the UK, Spain, Italy, Germany, Switzerland, Austria, Greece, and obviously a majority of French people). All the talks I have been able to attend were really interesting, and some of the slides have already been made available by their author: I have also taken part to the keysigning party, which will now allows me to use my newly generated 4096R key. The group picture is also online, as well as a more comprehensive gallery. Thanks a lot to the organisation team, you guys have made an awesome work! See you all next year!

Adnan Hodzic: I want Xperia X10 Android 2.1 update now!

Story I bought Xperia X10i this summer during DebConf10 in NYC, I loved this phone from very beginning however what bothered me was that it was still stuck on outdated Android 1.6. To get your own custom Android on it, wasn t quite possible because no one managed to hack bootloader even though some of the guys at XDA where getting pretty close. Long story made short, Sony Ericsson has finally release their Android 2.1 update, but made it available only for Nordic region, they explained it all on their blog where they also sent a message for paranoid users as they called them. I thought, if I gave it all this time I can wait a little bit longer, but then one of my friends (@sahinovic) gave me a good pointer to go in right direction with using custom ROM, Nordic for example? So this is where I got my idea. I want 2.1 update now! Please note steps below will get you Android 2.1 update, but AFAIK you ll also lose your warranty 1. Root your phone If you don t have your phone rooted, this can now be done in single click. Get X10 Root and follow instructions on screen. 2. Edit system/default.prop Get Root Explorer, mount r/w (upper right corner), edit system/default.prop Lines you re concentrating on are 1 and 3 Let s say they are:
ro.semc.version.cust=1237-0333
ro.product.name=X10_1237-0333
Edit them to look like:
ro.semc.version.cust=1234-8465
ro.product.name=X10_1234-8465
Save the file and it s gonna create automatic backup of original file. 3. Get the updates using SEUS Turn off your phone, launch SEUS, plugin in the USB cable while holding back button, SEUS is going to tell you have updates for your phone Smile Follow on screen instructions. Enjoy the update Smile Conclusion X10 is a pretty sweet phone, but with it being so closed, it also closes a lot of doors to hacking it and playing with it, great example would be this update itself, since right now Android 2.1 update is an outdated one. However 2.1 update brings new life into it, just as it s a brand new phone, it s more responsive and much much faster. And do take a backup before this update, because I lost everything from my contacts to internet settings, but all files on my sd card remained intact. If you want to discuss anything regarding this topic please do so in comment area below or find me on Twitter.

Rapha&#235;l Hertzog: 5 free software to support with Flattr

Flattr FOSS LogoIt s already the fourth issue of Flattr FOSS: it means 20 different projects using Flattr that I presented you. Here are the 5 suggestions for November:
  1. Redshift is a small utility that adjusts the color temperature of your screen to make it less aggressive on your eyes, in particular during evening/nights. It uses the time of the day and the geographic location to know whether it s night or day. I discovered it this summer and I liked it, although I m not running it permanently.
  2. Noscript is a Firefox plugin to control what sites can execute javascript, flash and other plugins. All those are creating supplementary security risks and you browse safer if you allow only some sites to run them. This is the number one entry on Flattr in the opensource category, it recently took the place of dpkg.
  3. phyMyAdmin is a web interface to manage MySQL databases. If you have such a database on a web-hosting service, you have likely already seen it in action. It s an award-winning software with a 12 year history, it s not so common for PHP applications. :-)
  4. Chromium maintenance in Debian. Chromium is a rapidly-evolving & complex software and Giuseppe Iuculano has been tirelessly working on packaging it. Almost alone within Debian. He deserves kudos for his work even though he reused work made by Fabien Tassin on the Ubuntu package.
  5. Dulwich is a pure-Python implementation of the Git file formats and protocols. It s an important building block for interoperability between Bazaar and Git: bzr-git (a Bazaar plugin providing Git integration) is notably using it. Given the large usage of bzr in Ubuntu and the popularity of Git world-wide, it s important to have such gateways.
This article is part of the Flattr FOSS project.
Update: mentioned the work of Fabien Tassin on the chromium package within Ubuntu.

Flattr this Share/Bookmark 6 comments Support my work

Russell Coker: Communication Shutdown and Autism

The AEIOU Foundation The AEIOU Foundation [1] is a support and advocacy organisation for people on the Autism Spectrum, note that they clearly say Autism Spectrum Disorder (ASD) on their About page, some of what they write would be less wrong if it was claimed to apply to only non-verbal Autistics or people claimed to be Low Functioning Autistic (LFA). But in regard to the Autism Spectrum they just don t seem to know much about it, a lot of their web pages seem to be based on the assumption that anyone who is on the Spectrum will be lucky if they can ever live independently. However it seems that most people who can be diagnosed with an ASD have typical social skills by the standards of the IT industry and can get by without any special assistance. The entire site seems to be written about people on the Spectrum by people who know little of their experiences and contains hardly any information that matches what I ve read from various people on the Spectrum (of course there are a wide range of experiences that differ greatly). They have a link to Autism Related Sites which starts with Autism Speaks (the Wikipedia page about Autism Speaks is worth reading note the section about immunisation research which has been repeatedly debunked and the section about legal action against a young autistic blogger). There are many good reasons why Autism Speaks is so widely hated among people on the Spectrum. I think that recommending Autism Speaks is a sign of willful ignorance of almost everything related to Autism. In their page about describing Autism to NTs they say Imagine if you suddenly woke up in a foreign country, did not speak the language and had no way of effectively communicating with the people around you . I ve been diagnosed with Asperger Syndrome by a psychologist who considers that to be the same as High Functioning Autism (HFA) and I ve visited more than a few countries. I find the comparison of the Autistic experience to visiting another country to be so strange that I don t even know where I would begin if I was to comment on where it went wrong. Finally they have a scrolling bar listing their advertisers at the bottom of ever single page on their site. If someone was going to design a web site specifically to annoy people on the Spectrum then such a scrolling banner would be a good place to start. Now they probably do some good things to help families with children on the Spectrum. But their ability to do good is really hindered by the lack of input from people on the spectrum, Rachel Cohen-Rottenberg (leader of the Vermont Chapter of the Autistic Self Advocacy Network) wrote an interesting post about AEIOU and noted that none of the people who run AEIOU are Autistic [2]. The Communication Shutdown Someone got the idea that Neuro-Typical people (NTs) should try and understand what it s like to be on the Spectrum which is a reasonable idea. But they decided that the way to do so is to have them refrain from Internet based socialisation and not use Facebook and Twitter for one day. It seems to me that most people on the Spectrum primarily socialise via the Internet, so ceasing Internet based socialisation is likely to make their experience less like that of people on the Spectrum. I m getting a mental image of a bunch of NTs deciding to go to a night-club for their Internet free evening and then imagining that they are somehow empathising with the experience of people who can never enjoy a night-club. As an aside, a web site which has anything at all related to disabilities shouldn t rely on Flash the Communication Shutdown site totally fails in this regard. No Stereotypes Here has an interesting analysis of this situation, among other things they comment on the irony of having someone ask them to stop using twitter as part of this campaign [3]. One thing that they suggest is for NTs to have a day without any communication at all. Some Suggestions for People who Want to Understand As a communication exercise, try going shopping without speaking, just use hand gestures. For bonus points try doing so in a foreign country where you don t know the language so you need bidirectional non-verbal communication with some luck you can complete a transaction without the shopkeeper realising that you are a foreigner. This won t actually give you much of the Autistic experience, but it s a good exercise in understanding how communication works. Someone who wanted to know the down-side of being on the Spectrum could find a sports bar where most patrons support one team and then enter the bar while wearing a jersey indicating support for an opposing team. I don t recommend doing this because it really wouldn t be fun, but for a quick approximation of the experience it would probably work well. It seems to me that paying $5 to a charity and then boasting about doing so on your Facebook page for a day is an easy thing to do. A harder task would be to spend a day reading about the experiences of the people in question and then giving $5 to a charity that is well regarded by the target group. Another possible way of gaining some understanding would be to have a party where everyone brings their laptop and uses only electronic communication no speaking at all. This is in fact fairly close to what some of the Geekier (possibly Autistic) members of the IT community do.

Michal &#268;iha&#345;: Cleaning up the web

After recent switch of this blog to Django, I've also planned to switch rest of my website to use same engine. Most of the code is already written, however I've found some forgotten parts, which nobody used for really a long time. As most of the things there is free software, I don't like idea removing it completely, however it is quite unlikely that somebody will want to use these ancient things. Especially when it quite lacks documentation and I really forgot about that (most of them being Turbo Pascal things for DOS, Delphi components for Windows and so on). Anyway it will probably live only on dl.cihar.com in case anybody is interested.

Filed under: Django Website 0 comments Flattr this

Jaldhar Vyas: It Came From Beyond Nordstrom

Shailu as vampire princess Shailu is supposed to be a vampire princess but the effect is spoiled because she wouldn't wear the fangs. We didn't see even one Lady Gaga. I thought that was supposed to be the hot costume this year?

31 October 2010

Lucas Nussbaum: Mini DebConf Paris 2010

So, I m (almost) back from the first edition of MiniDebConf Paris, which was a success thanks to the great organizing skills in panic mode of Carl Chenet and Mehdi Dogguy. I think that everybody is already looking forward to the next edition. I met lots of people, and it was great to be able to finally put faces on names from the french free software community. I gave two talk there, the first one on Debian and Ubuntu (slides), the second one on Debian Quality Assurance (slides), which both went well (I think). I also hacked a bit: If you want to help me, here are some easy tasks that need takers (it s unlikely that I ll be able to tackle them anytime soon): One of the other things I d like to do is discuss ways to improve the synchronization of UDD (currently, it s synchronized at arbitrary times, while we could sync Sources+Packages just after dinstall, for example).

Stefano Zacchiroli: mini debconf paris - success

I'm just back home after Paris mini-DebConf. I'm happy, excited, and exhausted almost as if it had been a full fledged DebConf. That's enough in my book to consider the event a complete success. As far as I know, it has been the first mini-DebConf held in Paris and about 150 people have come to attend the event from all over Europe. Off the top of my head I've met friends from at least: Spain, UK, France (obviously!), Italy, Germany, Austria, Switzerland, Greece. I'm still very much impressed by such a diverse attendance. Initially, I had planned the first "DPL strike" ever (i.e. not doing anything DPL-related) for the duration of the conference, in order to take part into the BSP. That agenda has been pretty much subverted by a last minute emergency, by chatting with loads of people, and by actually finalizing the Debian Sprint Program, which had been at the top of my Debian TODO list for quite a while now. Nonetheless, I've managed to advance a bit on a couple of RC bugs, which belong to the "annoying/pointless/but-still-valid" category. They are not solved yet, but I hope to have good news to share soon. Bottom line: I loved the event. and I've even managed to avoid getting killed by my (local) family for taking part in a Debian-weekend after an almost full week of Debian traveling, which is another success on its own right :-) Closing advice: beside some last minute legwork, I did essentially nothing to organize this mini-DebConf, your kudos should be better directed to Carl Chenet and Mehdi Dogguy for the organization. Other gifts such as bug fixes can be directed to the speakers, sponsors, and loads of other helpers from Debian France and not in particular Xavier Oswald, Valessio Brito, Tanguy Ortolo, Nattie Mayer-Hutchings, Luca Capello, Stephane Glondu, and others which surely I'm forgetting to mention here (sorry about that). Kudos folks ... let's do it again next year! (SCNR)

Eddy Petri&#537;or: HP All-in-one models - the way to extort money

Dear HP,

I bought a HP Photosmart C5380 All-inOne multifunctional unit. It is supposed to be a printer, a scanner and a copier, being able to print on paper, CDs, DVDs and photopaper.

First of all I dislike the way you force me to buy new ink cartridges even if there is still ink in the current cartride. I hope somebody reverse-engineers as soon as possible your 364/364XL cartridge chips so I can use my printer at a price lower than that necessary for a tank fill for my car!

Second, even if one of my cartridges is missing or defective , the previous one, the empty one which the current one replaced, is definetly OK, so fuck you and your money extrosion schemes.

Third, and the reason for this rant, is that even if ALL the cartridges are empty, I should be able TO USE THE FUCKING SCANNER FUNCTION, since it doesn't depend on the fucking supposedly missing ink! But I can't because you decided that scanning probably needs ink, otherwise I don't understand why would you block the functioning of the whole unit because of some presumed missing ink issue.

I should probably return this device and ask my money back because of this and when they deny this to make a huge scandal about it.

So, HP, FUCK YOU, you well dressed money extortionists!

Next.

Previous.