Search Results: "ag"

1 September 2008

Jeff Licquia: Comment Policy Updated: No More CAPTCHA

The comment policy has changed; check the page links for the details. The big change: I’ve turned off the CAPTCHA page that would be presented for comments judged to be “borderline” spam by the spam filter software. For those not aware, CAPTCHA is the name given to the funny letters and numbers on weird backgrounds that you sometimes have to type in to do things on certain web sites. The idea was that computers couldn’t read those letters and numbers, but humans could; thus, each solved CAPTCHA was proof that a human had done whatever it was that had been done. CAPTCHA had issues even from the beginning. They present obvious issues for the blind, and were often simple enough to be read by modern OCR software. Because of this, I never turned it on for every comment, and any comment rejected because of the CAPTCHA just went into the moderation queue. But I’m now convinced that CAPTCHA has reached the end of its useful life. So when a commenter on my last post expressed his dissatisfaction with my CAPTCHA, I decided it was time to turn it off. And so, references to it have been expunged from my comment policy. The Esperanto translation of my comment policy has also been updated, in the hopes that I might someday post a little more often in that language. It’s also been moved to a page.

Thijs Kinkhorst: DOMjudge 2.2.1 released

DOMjudge logo A few weeks ago we released version 2.2.0, and now version 2.2.1 of DOMjudge, our programming contest jury system. I'm actually very satisfied with the 2.2 branch because it implements some important wishes that users of the system had, especially moving nearly all state into the one central database instead of spread over db, files and hosts. It is getting more and more complete on the functionality side. Our next target, 3.0, will focus on a different part: installing the system and getting it running is not quite trivial. The system has grown organically, and the current setup procedure tries to install everything at once, from building the judging environment, setting up the web interface to generating the documentation. We aim to pull that apart so it gets easier and the administrator keeps better oversight. But that's all for the next contest season. Meanwhile, the 2.2.x branch will be maintained for bugfixes at least until ultimo 2008.

Joey Hess: human nature

Have you noticed that 90% of the 30-day fscks on laptop boot happen when it's on battery power? Even if it's only on battery power 50% of the time. One of these days I need to fix it so that ctrl-c makes it cleanly abort, rather than mount the disk read-only and fail to boot. Also, Amazon prime is super dangerous. I tried their free trial and bought a large amount more books and stuff online than I usually would. Their usual free shipping requires bundling things up over time, and delays the instant gratification by shipping slowly. That tends to discourage impulse buys very nicely. Which is a weird decision for a company to make.

Biella Coleman: Getting there

The fall semester is right around the corner and I have spent the last week obsessively tweaking my hacker course. I think I finally crafted a syllabus I can live with for the rest of the semester. I say “live with” because of what I excluded, which I simply did not want to (notably there is no material on DeCSS/DMCA, hacking the I-Phone, and I wanted to do more on encryption). But the good thing is I will be teaching this again in the future and will learn how to rotate in and out some of this material. Now I am off to enjoy a final free day before teaching responsibilities really begin.

Neil Williams: Emdebian, cache files and MIPS

The current method of patching into place a series of ./configure variables as $(DEB_HOST_GNU_TYPE).cache files is becoming a pain - it blocks native builds of Emdebian packages for a start. So, I've been experimenting with a different method of support.
Centralised cache value support
Initially, I've collated all the current cache values needed (i.e. beyond the ones already provided for specific architectures) into /etc/dpkg-cross/cross-config.cache and have a script in emdebian-tools called emcache that will manage the central values by comparing them to the real values used in each build tree.
So, cache values, what are they?
  1. Cross-builds fail if ./configure tries to compile a test program and then try to execute it because it will have been compiled with the cross-compiler - instead, the cross-build passes the value that the test was trying to calculate so that ./configure does not need to try to execute any cross-compiled code.

  2. The values are derived from native builds, written to a $(DEB_HOST_GNU_TYPE).cache file that is passed to ./configure via debian/rules.

  3. The values turn out to be mostly (completely?) architecture-independent, so are eminently suitable for collation into a central cache file.

  4. Quite package-specific. There is some overlap but most are customised for a specific package. This led to a development of the central cache file: package-maintained cache files to support extensibility.

Package maintained cache files
I'm now experimenting with cache files written (and maintained) by packages during normal builds and dropped into /etc/dpkg-cross/cross-config.d/ - which would later migrate into dpkg support. Ideas welcome!
The basic idea will be that IF cross-building, the build process would check for /etc/dpkg[-cross]/cross-config.d/$source_package and, if found, add that to the cache value list for that build.
Cache files are shell scripts so this it be manageable to bring some intelligence to the process.
Where does MIPS come in?
Well, all the builds, so far, have been ARM or armel (where the cache values are likely to be identical) and i386 (which doesn't need a cross-compiler at all and therefore does not need cache files). MIPS is the first chance to check the cache values and ensure that the above criteria really are true.
Now that we have a volunteer looking at MIPS, the current MIPS builds are a suitable test bed.
What does this have to do with Debian?
Once Lenny is released, I'll be looking to implement this support via the long term mass bug filing for cross-build support into the packages themselves. It is possible that the process can be entirely automated - as long as the script knows which values are relevant. A normal cache file, post-build, can be very, very long whereas most cache files for Emdebian are just a few lines long - the longest is about 20 lines.
The current process is outlined on the Emdebian website, including a list of packages that currently need cache files to cross-build.
Oh, and just a note - when I start this phase of the long term mass bug filing, I'll first do delayed NMUs for the existing bug reports - hence the delay until Lenny is released.
In order to speed things along, I have also been doing some RC bugs - downgrading some, fixing others etc. (I've finished 6 since coming back from DebConf, so far, IIRC.) All efforts to get Lenny released will help Emdebian too, so if you want to help Emdebian, then help Lenny get out of the door and let's get to work on Squeeze.
:-)
(Squeeze is a great name for a release with lots of fixes for embedded stuff, don't you think?)

MJ Ray: Oddments from Planet Debian

Three replies to things I saw today on Planet Debian on blogs of people that don’t have fully-working web comment systems:-
  1. Professional Slide Installer (usual buggy blogger.com CAPTCHA) - yes, they exist. My village’s council sometimes hires them. I think they’re carpenters who have specialised. There are also professional slide inspectors (well, childrens’ play area safety inspectors, but professional slide inspector sounds cooler).
  2. Internet Speed Hype (usual buggy wordpress kind-a captcha) - ThePhone.Coop (UK) doesn’t cap, but charges extra if you go over your subscription amount. We have a monitoring system that lets you check your usage fairly easily and set up email alerts when your prepaid amount is almost used up. (I work for agent AG_471 of ThePhone.Coop but I think I’d like them anyway.)
  3. home of the madduck/ blog/ Recovering a lost default route (site under construction - see bottom of page) - I was told by a very wise man to always start a delayed reboot (shutdown -r +5) before messing with anything to do with the networking on a remote machine.

MJ Ray: The Phone Co-op: interview, phorm, challenges

Among other things, my webmaster cooperative is an agent for the Phone Co-op. Particularly with Free Software, cost-efficient ways of downloading data is a good companion service to have and the Phone Co-op has given a good ADSL and calls service to my own home and office for a few years now. When there are problems, they’ve worked pretty well to fix them. Just last week, I had a phone call to tell me when routing problems in LINX were fixed… which was a great help. I don’t remember an ISP doing that for me for years. I think the last one was my university’s dial-up service, 10 or more years ago. Another unusual thing for a UK ISP is the excellent public position on the Phorm ad-snooper that I mentioned previously: We strongly oppose these practices, especially the loss of privacy [...] Phorm is not operating on our users’ lines and we have required and received assurances from our suppliers that this will remain the case. Our Chief Executive Vivian Woodell gave an interview to the FT (accept the first two cookies, then block the rest, else you only get two paragraphs) which has a pretty good explanation of how the business side of the cooperative works. We’re recruiting for Line Rental (PSTN and ISDN) until the end of the year, including special offers like residential Unlimited Anytime Calls for 7.95 a month (normally 9.99) at the moment, as well as the great climate-neutral and ethical policies - if your landline contract renewal comes up, give it a look. The Phone Co-op was ten years old in June, but there are still big challenges: I’d love to see a cooperative pay-as-you-go mobile phone service and the mobile contract offers still look a bit expensive to me (no bundled data on phones, 25 per month for a 3G data card). I’d also love to see support for some daring innovative solutions like customers owning their own tails (tails are the last link to their house, where most of the UK has a choice of one provider: BT), using that as a way to upgrade small towns and villages to fibre-optic, or offer resident-owned wifi. Update: As if by magic, Ofcom has started a social web consultation about mobile phone services. Go comment.

Nico Golde: squeeze

Say Hi to Squeeze, the Debian version that will be released after Lenny (and of course when it's ready)!

Ingo Juergensmann: Initramfs problems with RAID setup

Yesterday a server at work needed some care - which was the reason why I had to leave the m68k porters meeting early. It was intented to migrate the filesystem to a RAID1 setup instead of using just a single disk.

Of course I tested everything in advance and it worked. Sadly Murphy did hit the scene as well and the previously tested upgrade path failed: somehow the RAID couldn't be started and the boot progress stopped.

Actually, the error was this one:


Failure: failed to load Module 1 no such module


Useless to say that the initrd was uptodate and included all necessary modules!

Luckily someone else happened to stumble upon the same problem last year and it was well documented on debian-user mailing list in a thread between Andrew Sackville-West and Martin F. Krafft , properly archieved by some mirrors.

So, the problem was in some mdadm script that was executed during boot process and which parsed the ARRAY definition in that way that the kernel modules couldn't get loaded.
If you follow the thread on that mailing list you'll come to the following hint:


Try the following patch agaist
/usr/share/initramfs-tools/hooks/mdadm. It ensures that RAID levels
include the word 'raid'. I think your mdadm.conf may say stuff like
level=5, when it should say level=raid5 or not specify level= at
all.


And yes, my ARRAY definition in mdadm.conf just stated level=1 as well. So after setting it to level=raid1 everything worked again.

Thanks, Andrew and Martin for solving that problem a year ago! :-)

31 August 2008

Joerg Jaspert: Pdiffs

Is anybody out there really using the Pdiffs we offer for apt & co? I have them turned off on all my machine as they only make apt slower on every machine I know, I can’t see any benefit from them. Only seem to blow up the download time A LOT, waste space on mirrors, time in dinstall (well, 2 minutes, but still), … It seems to me to be a feature that would have been useful some decades ago, where you had something called floppy discs to transfer files. But nowadays even ISDN should be fast enough to not require them? Can someone enlighten me please and comment here? Thanks. Comments: 14

Michael Schutte: Perhaps if I eliminate no, wait, this won t work

In today s episode of Tatort, a German-language TV series Martin blogged about some time ago, I had to laugh at this line:
You are a computer scientist, aren t you? What we ve got here is an equation with two variables. You certainly know that this easy to solve.
Interestingly, the same mistake can be found in an older episode of another German TV series called Der Bulle von T lz. A part of a dialogue between a detective and a teacher went like this:
Detective: Was she a good student?
Teacher: Not at all. She even cannot solve a simple equation with two variables.
Dear screenwriters, when in doubt, please stay away from maths. And while we re at it, there is no need for fingerprint matching software to show every fingerprint from the database on the screen and emit lots of short beeps while doing that. Your programmes are more enjoyable without this stuff. Update: As this post has triggered responses: First, I do not deny the overall quality of Tatort it is a great series. Second, of course there are systems of equations with more variables than equations which can be solved. But these aren t straightforward and certainly not what the people I m talking about had in mind

Martin Michlmayr: Cannot connect to debian-installer via SSH: mystery solved?

I finally found the time today to dig into oldsys-preseed and what I found wasn't pleasant. In fact, I may have solved the mystery why some people trying to install Debian on their NSLU2 cannot connect to the installer via SSH. oldsys-preseed is used on certain NAS devices to read the network configuration from the original firmware and these values are used to bring up SSH in debian-installer. If you used DHCP in the original firmware to obtain an IP address, debian-installer will do the same. If you have a static IP config, debian-installer will use it. In theory, it's all pretty simple, but users often run into troubles when a static IP config is used (as is the case on the NSLU2). While you only need an IP address, netmask and gateway to bring up SSH (and then you could configure the rest, such as DNS and hostname), debian-installer expects everything at the same time. I've seen many cases where users couldn't connect to the installer because they forgot to configure their DNS in the original firmware or some other values they didn't think were important. Anyway, right now oldsys-preseed will use a static configuration if the firmware is configured this way even if it's clear that netcfg won't like this configuration because of missing values. The IP address and DNS are always required, but the netmask and gateway can be figured out automatically. I wanted to add a sanity check that would choose DHCP in case the IP address or DNS were not specified. While working on this sanity check, I noticed two things: First, the "empty" value oldsys-preseed preseeds when there's no netmask or gateway is not accepted by netcfg and leads to an error message (which the user cannot see because SSH is not up yet). I'm pretty sure I tested this scenario when I wrote oldsys-preseed but it clearly doesn't work today and I don't see how it could ever have worked. This is pretty significant because having an empty gateway is a valid configuration (if hopefully not too common). Second, it seems that it's impossible to create a preseed file that tells netcfg that no gateway should be used. If you preseed an empty value, netcfg will simple use .1 as the gateway. I've fixed the first problem and proposed a patch to put in a special case to allow preseeding of no gateway. The sanity check that chooses DHCP when the network configuration is incomplete is also there now.

Russell Coker: Links August 2008

Michael Janke is writing a series of posts about estimating availability of systems, here is a link to the introduction [1]. He covers lots of things that people often miss (such as cooling). If you aren’t about to implement a system for reliability then it’s an interesting read. If you are about to implement a system where reliability is required and you have control of the system (not paying someone else to run it and hope for the best) then it’s an essential read. It will probably also be good to give this URL to managers who make decisions about such things. Interesting summary of the connections between the Iraq war and the oil industry in the Reid Report [2]. The suggestion made by one of the sources she cites is that the intention of the war was to reduce the supply of Iraqi oil to increase prices. Sam Varghese has written an essay about this which summarises where the Iraqi oil goes [3]. It seems that half of Iraq’s oil goes to US military use, the other half is used domestically, and some oil is imported as well! So because of the US occupation the country with the second largest known oil reserves is importing petroleum products! If the US military was to cease operations world-wide then the oil price would drop significantly, this doesn’t just mean the occupation of Iraq and the various actions in South America, but also the bases in Germany and Japan. Interesting paper by Alexander Sotirov and Mark Dowd about Bypassing Browser Memory Protection in Windows [4]. This paper is good for people who are interested in computer security but don’t generally use Windows (such as me), if you want to learn about the latest things happening in Windows land then this is a good place to start. A well researched article by Rick Moen about the unintended effects of anti-gay-marriage laws [5]. Maybe some of the “conservatives” who advocate such laws should get themselves and their spouses tested. It would be amusing if someone like Rush Limbaugh turned out to be involved in a “gay marriage”. What Sysadmins should know about exposure to hazardous materials [6]. High-level overview of the issues, probably a good start for some google searches to get the details. Diamond John McCain is an interesting blog about the 73 year old (who was born in Panama) candidate in the US presidential election [7]. Update: Corrected my statement about Iraq’s oil reserves based on a comment by Sam.

Biella Coleman: The making of

One of my favorite things to watch are the “making of [movie, documentary etc] segments that are now routinely included in any DVD. It is nice to look behind the curtain and see exactly what choices are made, what is excluded, and why they are made. I wish that more books, especially academic ones, had a “making of” section, giving a window into these choices. We are not exactly encouraged to include this commentary in the book itself but one can find this type of insight in author interview. I recently read one such interview with the author of Two Bits: The Cultural Significance of Free Software. The interview is on his site and the original is here. There are a couple of things that I found particularly interesting, such as how to treat iconic figures such as RMS and ESR [not as researchers, for example :-) ] and the importance of letting your research and thinking brew over a fairly long period of time, despite the pressure of publishing fast, quick and dirty, which is especially strong with anything “digital.” The book is hefty and long, but as is emphasized in the interview, it is also pragmatic and readable. If folks on Planet have not yet checked it out and are not ready to commit to a long book, I would checkout Chapter 6 on the creation of the copyleft. It is sure to please academics and geeks alike.

Steve Kemp: There can be only one

When volume becomes high enough you start to observe patterns in SPAM pretty easily. I think that this is primarily because people like to see patterns, whether they are present or not. The trick is determining whether they are real patterns or not, and then to a lesser extent whether they are useful patterns. For example I host mail for a business domain. That means that incoming messages come primarily from existing customers, and very rarely from potential new ones. In practise that means that email is expected to arrive from 9am til 6pm (+/-2hours) Email received at 2AM? Either it is somebody working remotely, a foreign contact, or much more likely it is SPAM. Now clearly you cannot dump all messages received at unusual times of the day, but it is a surprisingly robust SPAM indicator for that particular domain. All heuristics are fallable, but some are useful regardless.. I'd love to know what people can learn from their SPAM. This week I'm handling approximately 80,000 messages a day, per MX, which isn't huge (ie. 2-3 million a month). ObQuote: Highlander

Martin Michlmayr: Please test daily debian-installer images

debian-installer is now using the 2.6.26 kernel (the version the kernel team wants to release lenny with) and 2.6.26 has moved to testing a few days ago. As such, it's a great time to test the daily installer images to make sure our installer for lenny is in a good state. There's still time to fix bugs in the installer, but we need your feedback. Daily images can be obtained from the debian-installer web site which also contains instructions about how to submit installation reports. I'm particularly interested in reports about installations on ARM and MIPS. If you want to test debian-installer on these architectures, please read my messages on debian-arm and debian-mips.

30 August 2008

Steve McIntyre: Been a bit quiet lately

Sorry, ever since Debconf I've been busy, ill and otherwise distracted. I'm still catching up... Stuff that's happened: Dude, you're married! For the second year running, I had to leave Debconf a day early to attend a wedding party. My good friend Matthew married Oxana last Monday. I've just put my photos of the happy event online today. After a successful Debconf where I managed to evade the normal plague, it hit hard on the Tuesday morning and I've been struggling with it ever since. Just about over it now, but I've been feeling crap for over a week. On the way to Buenos Aires to catch my flight back to England, I received a text message telling me the sad news that my uncle, John Bolton had passed away. This means that the eldest two of my mum's three brothers have died this year, in the space of just a few months, and it's been a very hard time for the family. The funeral happened earlier this week, so I was away and mostly off-line for a couple of days travelling there and back. I'm trying to get back up to speed on a whole host of different things at the moment; if you're waiting on a response from me about Debian-related stuff, please feel free to prod me via email or IRC.

Andreas Barth: stale vs incomplete: xen vs kvm

Currently, I'm together with Marc Brockschmidt evaluating which virtualization to use on our new server. We want that our virtual systems feel like real systems, and we want an open source solution. So, vserver and the like is out of the game, as well as VMware. The two remaining solutions we looked at are Xen and kvm. Xen has of course the advantage of the matured. Also, we have experience with running xen servers - and with the issues that can happen, like the chances to disconnect dom0 from xend, and then reboot the server the hard way. However, the most serious disadvantage is that development has practically stalled with the 2.6.18-kernel. Of course, even of today one could install a new server based on Etch, but that doesn't really feel right. There is some development ongoing to run domUs with newer kernels (like in Lenny), but there isn't currently any new kernel available for dom0. kvm is a more recent addition to the virtualization camp, and is basically "qemu on steroids". All looks rather promising, development happens with the recent kernels. However, kvm lacks a few features of e.g. Xen. This includes the ability to reboot dom0 (and the hardware) and just let the domUs survive. Or to have a nice management script where one could just say "xm shutdown $domU", and have basically the power button be pressed on the virtual machine. Or to just attach and detach to the virtual console whenever one wants. Nothing of that is impossible with kvm, one could attach the command-terminal to some pipe, and the linux console to some other, and attach and distach via own scripts. But - all of that should be expected to be available from some solution that calls itself enterprise ready. (And - writing own scripts has always the possibility to make own mistakes.) However, among all the worst possible issue is that kvm is underdocumented (or rather: There are lots of different places where some parts of the documentation is hidden - including the great remark in the man page "The other options are similar to those of qemu."). So, what to do? Invest more time into a solution that seems like a dead end. Or put up with the incompletness of another solution?

Mark Brown: Apple Mail and format=flowed

There’s one thing that the Apple Mail client gets right which I’ve never seen anything else try to do - the way it formats messages. Most mail clients seem to offer plain text and HTML as user selectable options and do exactly what they’re told regardless of the content of the message. If HTML is enabled they always send a mail with both text/plain and text/html renditions of the message. Normally the plain text version is a fixed, 80 column version. This is wasteful of bandwidth, especially since very few users actually use any formatting at all, and means that mail programs that don’t do HTML have to treat the mails as though the fixed layout the sending system chooses is important even when it results in poor layout (for example, on mobile devices with small screens). What Apple Mail does here is to only enable the more complex formatting options if they add information that can’t be represented in the less complex formats. By default mails are sent in text/plain with the format=flowed option to let the reader know it can safely reflow the text and no HTML alternative is generated. If something that can’t be represented using format=flowed is included in the message then a HTML alternative is generated - transparently and without user intervention. This is good partly because it’s nice to see format=flowed used, it’s a nice technical solution to the problem, but mostly because it’s great user interface design. Most Apple Mail users will never notice if it is or isn’t generating HTML e-mail, they’ll just see that it’s doing what they expect and won’t have to deal with an option that they probably don’t understand or have much of a view on. Other users won’t be troubled with HTML generated by Apple Mail users unless there is some content in the formatting. It’d be good to see more MUAs implementing similar behavior, at least optionally.

Jeff Licquia: Internet Speed Hype

Reportedly, the USA is falling behind the rest of the world in bandwidth:
The 2008 median real-time download speed in the U.S. is a mere 2.3 megabits per second. This represents a gain of only 0.4 mbps over last year s median download speed. It compares to an average download speed in Japan of 63 mbps, the survey reveals. US also trails South Korea at 49 mbps, Finland at 21 mbps, France at 17 mbps, and Canada at 7.6 mbps, and the median upload speed was just 435 kilobits per second (kbps), far too slow for patient monitoring or to transmit large files such as medical records.
But don’t tell Chris Blizzard’s commenters. He writes about Comcast’s annoucement of a 250GB/month bandwidth cap, and gets an earful from commenters from Canada and Europe:
A boo hoo hoo. Major Canadian ISPs have had a limit of 60 GB for months, if not years. Oh wait probably the same way as most of the world manages on 10-20GB, for far more money than you re paying for $250. Not a lot of sympathy from this corner Yep, no sympathy from here either in Australia, with the only _independant_ ISP left, $280 AUD gets you 100GB. $50 with a major telco (the rest of the ISPs here) gets you 5GB. eg with my current ISP, a 8 MB line with a 300 GB monthly cap costs 20 GBP/month. A 8 MB line with unlimited bandwidth costs 160 GBP/month. Quite a difference! I pay the equivalent of $40 a month for 30GB, and extra GB on top are $3 each. That s with Plus Net (http://www.plus.net). I m in South Africa paying about $130 for a 10GB cap.
So who’s really better off? By my calculations, if a Canadian ISP provides 7.8 mb/s with a 60 GB cap, that’s about 17.5 hours per month of sustained maximum bandwidth before you’ve blown your limit. By contrast, an American ISP with 2.3 mb/s and a 250 GB cap gives you about 247 hours per month of sustained maximum bandwidth. Perhaps part of the answer is that only one country–Canada–shows up in the list of “faster countries” and in the comments section of Chris’s post. That could explain the apparent disconnect; maybe Great Britain and Australia are worse off than the USA, while Finland and Japan are better off. Still, this does bring the question to mind: which is better, raw speed, or the ability to actually use it without fear?

Next.

Previous.