Debian I ve had the great opportunity to go to the Debian Conference 2016. I ve been introduced to the debian community and debian developpers ( dd in short :p). I was lucky to meet with great people like the president of the FSF, John Sullivan. You can have a look at my Debian conference report here. If you want to read my debian reports, you can do so by browsing the Google Summer Of Code category on this blog.

What I have done Ring is now in official debian repositories since June 30th. This is a good news for the GNU/Linux community. I m proud to say that I ve been able to contribute to debian by working on OpenDHT and developing new functionalities to reduce network traffic. The goal behind this was to finally optimize the data persistence traffic consumption on the DHT. Github repository: https://github.com/savoirfairelinux/opendht

Queries Issues:

• #43: DHT queries

Pull requests:

• #79: [DHT] Queries: remote values filtering
• 93: dht: return consistent query from local storage
• #106: [dht] rework get timings after queries in master

Value pagination Issues:

• #71: [DHT] value pagination

Pull requests:

• #110: dht: Value pagination using queries
• #113: dht: value pagination fix

Indexation (feat. Nicolas Reynaud) Pull requests:

• #77: pht: fix invalid comparison, inexact match lookup
• #78: [PHT] Key consistency

General maintenance of OpenDHT Issues:

• #72: Packaging issue for Python bindings with CMake: $DESTDIR not honored
• #75: Different libraries built with Autotools and CMake
• #87: OpenDHT does not build on armel
• #92: [DhtScanner] doesn t compile on LLVM 7.0.2
• #99: 0.6.2 filenames in 0.6.3

Pull requests:

• #73: dht: consider IPv4 or IPv6 disconnected on operation done
• #74: [packaging] support python installation with make DESTDIR=$DIR
• #84: [dhtnode] user experience
• #94: dht: make main store a vector>
• #94: autotools: versionning consistent with CMake
• #103: dht: fix sendListen loop bug
• #106: dht: more accurate name for requested nodes count
• #108: dht: unify bootstrapSearch and refill method using node cache

View by commits You can have a look at my work by commits just by clicking this link: https://github.com/savoirfairelinux/opendht/commits/master?author=sim590

What s left to be done

Data persistence The only thing left before achieving the totality of my work is to rigorously test the data persistence behavior to demonstrate the network traffic reduction. To do so we use our benchmark python module. We are able to analyse traffic and produce plots like this one:

Plot: 32 nodes, 1600 values with normal condition test.

This particular plot was drawn before the enhancements. We are confident to improve the results using my work produced during the GSOC.

TCP In the middle of the GSOC, we soon realized that passing from UDP to TCP would ask too much efforts in too short lapse of time. Also, it is not yet clear if we should really do that.

• Add background on the gnome client
  
• Implement the API smartInfoHub in all the other clients
  
• Gather more information, such as bandwidth, resource consumption, security level, connection time, number of packets lost and anything else that could be deemed interesting
  
• Display information for every participant in a conference call. I began to implement it for the daemon on patch set 25 .

• Add background on the gnome client
  
• Implement the API smartInfoHub in all the other clients
  
• Gather more information, such as bandwidth, resource consumption, security level, connection time, number of packets lost and anything else that could be deemed interesting
  
• Display information for every participant in a conference call. I began to implement it for the daemon on patch set 25 .

• Week 1 & 2
  
• Week 3
  
• Week 4
  
• Week 5
  
• Week 6
  
• Week 7
  
• Week 8
  
• Week 9
  
• Week 10
  
• Week 11
  
• Week 12
  

• The ansible-module-foreman ansible module allows you to setup all kinds of resources like images, compute resources, hostgroups, subnets, domains within Foreman itself via ansible using Foreman's REST API. E.g. creating a hostgroup looks like:

  - foreman_hostgroup:
      name: AHostGroup
      architecture: x86_64
      domain: a.domain.example.com
      foreman_host: "  foreman_host  "
      foreman_user: "  foreman_user  "
      foreman_pass: "  foreman_pw  "
  

• The foreman_ansible plugin for Foreman allows you to collect reports and facts from ansible provisioned hosts. This requires an additional hook in your ansible config like:

  [defaults]
  callback_plugins = path/to/foreman_ansible/extras/
  

  The hook will report to Foreman back after a playbook finished.
• There are several options for creating hosts in Foreman via the ansible API. I'm currently using ansible_foreman_module tailored for image based installs. This looks in a playbook like:

  - name: Build 10 hosts
    foremanhost:
      name: "  item  "
      hostgroup: "a/host/group"
      compute_resource: "hopefully_not_esx"
      subnet: "webservernet"
      environment: "  env default(omit)  "
      ipv4addr:   from_ipam default(omit)  "
      # Additional params to tag on the host
      params:
          app: varnish
          tier: web
          color: green
      api_user: "  foreman_user  "
      api_password: "  foreman_pw  "
      api_url: "  foreman_url  "
    with_sequence:  start=1 end=10 format="newhost%02d"
  

• The foreman_ansible_inventory is a dynamic inventory script for ansible that fetches all your hosts and groups via the Foreman REST APIs. It automatically groups hosts in ansible from Foreman's hostgroups, environments, organizations and locations and allows you to build additional groups based on any available host parameter (and combinations thereof). So using the above example and this configuration:

  [ansible]
  group_patterns = [" app - tier ",
                    " color "]
  

  it would build the additional ansible groups varnish-web, green and put the above hosts into them. This way you can easily select the hosts for e.g. blue green deployments. You don't have to pass the parameters during host creation, if you have parameters on e.g. domains or hostgroups these are available too for grouping via group_patterns.
• If you're grouping your hosts via the above inventory script and you use lots of parameters than having these displayed in the detail page can be useful. You can use the foreman_params_tab plugin for that.

• Improved AppData metadata.
• Added ttyHS ports to selection.
• Localization updates.

Filed under: Debian English Gammu 0 comments

clearsign failed: Inappropriate ioctl for device

# mount devpts -t devpts /dev/pts

devpts /dev/pts devpts defaults 0 0

# mount /dev/pts

Week 10 & 11 During these two weeks, I ve worked hard on paginating values on the DHT.

Value pagination As explained on my post on data persistence, we ve had network traffic issues. The solution we have found for this is to use the queries (see also this) to filter data on the remote peer we re communicating with. The queries let us select fields of a value instead of fetching whole values. This way, we can fetch values with unique ids. The pagination is the process of first selecting all value ids for a given hash, then making a separate get request packet for each of the values.

This feature makes the DHT more friendly with UDP. In fact, UDP packets can be dropped when of size greater than the UDP MTU. Paginating values will help this as all UDP packets will now contain only one value.

• #71
• #110
• #113

Week 12 I ve been working on making the put request lighter, again using queries. This is a key feature which will make it possible to enable data persistence. In fact, it enables us to send values to a peer only if it doesn t already have the value we re announcing. This will substantially reduce the overall traffic. This feature is still being tested. The last thing I have to do is to demonstrate the reduction of network traffic.

• Antoine Beaupr has been allocated 4 hours again but in the end he put back his 8 pending hours in the pool for the next months.
• Balint Reczey did 18 hours (out of 7 hours allocated + 2 remaining, thus keeping 2 extra hours for August).
• Ben Hutchings did 15 hours (out of 14.7 hours allocated + 1 remaining, keeping 0.7 extra hour for August).
• Brian May did 14.7 hours.
• Chris Lamb did 14 hours (out of 14.7 hours, thus keeping 0.7 hours for next month).
• Emilio Pozuelo Monfort did 13 hours (out of 14.7 hours allocated, thus keeping 1.7 hours extra hours for August).
• Guido G nther did 8 hours.
• Markus Koschany did 14.7 hours.
• Ola Lundqvist did 14 hours (out of 14.7 hours assigned, thus keeping 0.7 extra hours for August).
• Santiago Ruano Rinc n did 14 hours (out of 14.7h allocated + 11.25 remaining, the 11.95 extra hours will be put back in the global pool as Santiago is stepping down).
• Thorsten Alteholz did 14.7 hours.

• Platinum sponsors:
• TOSHIBA (for 10 months)
• GitHub
• Gold sponsors:
• The Positive Internet (for 26 months)
• Blablacar (for 25 months)
• Linode LLC (for 15 months)
• Babiel GmbH (for 4 months)
• Plat Home (for 4 months)
• Silver sponsors:
• Domeneshop AS (for 25 months)
• Universit Lille 3 (for 25 months)
• Trollweb Solutions (for 23 months)
• Nantes M tropole (for 19 months)
• University of Luxembourg (for 17 months)
• Dalenys (for 16 months)
• Univention GmbH (for 11 months)
• Universit Jean Monnet de St Etienne (for 11 months)
• Sonus Networks (for 5 months)
• Bronze sponsors:
• David Ayers IntarS Austria (for 26 months)
• Evolix (for 26 months)
• Offensive Security (for 26 months)
• Seznam.cz, a.s. (for 26 months)
• Freeside Internet Service (for 25 months)
• MyTux (for 25 months)
• Linuxhotel GmbH (for 23 months)
• Intevation GmbH (for 22 months)
• Daevel SARL (for 21 months)
• Bitfolk LTD (for 20 months)
• Megaspace Internet Services GmbH (for 20 months)
• Greenbone Networks GmbH (for 19 months)
• NUMLOG (for 19 months)
• WinGo AG (for 18 months)
• Ecole Centrale de Nantes LHEEA (for 15 months)
• Sig-I/O (for 12 months)
• Entr ouvert (for 10 months)
• Adfinis SyGroup AG (for 7 months)
• Laboratoire LEGI UMR 5519 / CNRS
• Quarantainenet BV
• GNI MEDIA

2 comments Liked this article? Click here. My blog is Flattr-enabled.

    sudo apt-get install apertium-en-es xclip coreutils

    macro pager <F2> "<enter-command>set pipe_decode<enter><pipe-entry> sed '1,/^$/d'   apertium es-en   less<enter><enter-command>unset pipe_decode<enter>" "translate from spanish"

    function s:Translate()
        silent !clear
        execute "! apertium en-es " . bufname("%") . "   tee >(xclip)"
    endfunction
    command Translate :call <SID>Translate()

• Kali Linux s Experience of a Derivative Tracking Debian Testing
• 2 Years of Work of Paid Contributors in the Debian LTS Project
• Using Debian Money to Fund Debian Projects

• I made an open-vm-tools NMU to get the package back into testing.
• I filed #830795 on nautilus and #831737 on pbnj to forward Kali bugs to Debian.
• I wrote a fontconfig patch to make it ignore .dpkg-tmp files. I also forwarded that patch upstream and filed a related bug in gnome-settings-daemon which is actually causing the problem by running fc-cache at the wrong times.
• I started a discussion to see how we could fix the synaptics touchpad problem in GNOME 3.20. In the end, we have a new version of xserver-xorg-input-all which only depends on xserver-xorg-input-libinput and not on xserver-xorg-input-synaptics (no longer supported by GNOME). This is after upstream refused to reintroduce synaptics support.
• I filed #831730 on desktop-base because KDE s plasma-desktop is no longer using the Debian background by default. I had to seek upstream help to find out a possible solution (deployed in Kali only for now).
• I filed #832503 because the way dpkg and APT manages foo:any dependencies when foo is not marked Multi-Arch: allowed is counter-productive I discovered this while trying to use a firefox-esr:any dependency. And I filed #832501 to get the desired Multi-Arch: allowed marker on firefox-esr.

3 comments Liked this article? Click here. My blog is Flattr-enabled.

• #12448 Avoid using Short-Keys in GPG
• #12446 Not listing 4th column in table 'dos'
• #43 Verify downloaded sources
• #46 Specify version in variable
• #38 Cannot change configuration options
• #41 PMA DB/Configuration Storage Missing from Docker Container Capability
• #45 Verify downloaded tarball using PGP
• #42 config.userdef.inc.php hook to allow user configured settings.
• #44 User configurattion

Filed under: Debian English phpMyAdmin 0 comments

Filed under: Debian English 0 comments

The following alphabetical list is incomplete; please suggest missing people:
Russ Allbery, Ben Finney, Sam Hocevar, Steve Langasek, Charles Plessy, Noah
Slater, Jonas Smedegaard, Lars Wirzenius.

  * Include the new (optional) copyright format that was drafted as
    DEP-5.  This is not yet a final version; that's expected to come in
    the 3.9.3.0 release.  Thanks to all the DEP-5 contributors and to
    Lars Wirzenius and Charles Plessy for the integration into the
    Policy package.  (Closes: #609160)
 -- Russ Allbery <rra@debian.org>  Wed, 06 Apr 2011 22:48:55 -0700

debian-policy (3.9.3.0) unstable; urgency=low
  [ Russ Allbery ]
  * Update the copyright format document to the version of DEP-5 from the
    DEP web site and apply additional changes from subsequent discussion
    in debian-devel and debian-project.  Revise for clarity, to add more
    examples, and to update the GFDL license versions.  Thanks, Steve
    Langasek, Charles Plessy, Justin B Rye, and Jonathan Nieder.
    (Closes: #658209, #648387)

• I've retired a couple of times, to pursue other interests, and then un-retired.
• I've maintained a bunch of different packages, most importantly the PGP2 software in the 90s. (I now only maintain software for which I'm also upstream, in order to make jokes about my upstream being an unco-operative jerk, and my packager being unhelpful in the extreme.)
• Got kicked out from the Debian mailing lists for insulting another developer. Not my proudest moment. I was allowed back later, and I've tried to be polite ever since. (See also rules 6.)
• I've been to a few Debconfs (3, 5, 6, 9, 10, 15). I'm looking forward to going to many more in the future. It's clear that seeing many project members at least every now and then has a very big impact on project cohesion.
• I had a gig where I was paid to improve the technical quality of Debian. After a few months of bug fixing (which isn't my favourite pastime), I wrote piuparts in order to find new bugs. (I gave that project away many years ago, but it seems to still be going strong.)
• I've almost ran for DPL twice, but I'm glad I didn't actually. I've carefully avoided any positions of power or responsibility in the project. (I live in fear that someone decides to nominate me for something where I'd actually have make important decisions.) Not being responsible means I can just ignore the project for a while when something annoying happens. (Or retire again.) With such a large project, eventually something really annoying does happen.
• Came up with the DEP process with Zack and Dato. I also ran the second half of the DEP5 process to get the debian/copyright machine readable format accepted. (I'm no longer involved, though, and I don't think DEP is much now.)
• I've taught several workshops about Debian packaging, including online for Debian-Women. It's always fun when others "get" how easy packaging really is, despite all the efforts of the larger variety in tooling and random web pages go to to obscure the fundamental simplicity.
• Over the years 've enjoyed many of the things developed within Debian (without claiming any credit for myself):
  • the policy manual, perhaps the most important technical achievement of the project
  • the social contract and Debian free software guidelines, unarguably the most important non-technical achievements of the project
  • the whole package management system, but especially apt
  • debhelper's dh, which made the work of packaging simple cases so easy it's nearly a no-brainer
  • d-i made me not hate installing Debian (although I think time is getting ripe to replace d-i with something new; catch me in a talkative mood at party to hear more)
  • Debian-Women made an almost immediate improvement to the culture of the larger project (even if there's still much too few women developers)
  • the diversity statement made me a lot happier about being a project member.
  I'd like to thank everyone who's worked on these and made them happen. These are important milestones in Debian.
• I've opened my mount in a lot of places over the years, which means a lot of people know of me, but nobody can actually point at anything useful I've actually done. Which is why when I've given talks at, say, FOSDEM, I get introduced as "the guy who shared an office with Linus Torvalds a long time ago".
• I've made a number of friends via participation in Debian. I've found jobs via contacts in Debian, and have even started a side business with someone.

static void *udev_symbol(const char *symbol)
 
    static void *libudev;
    static pthread_mutex_t  find_lock = PTHREAD_MUTEX_INITIALIZER;
    void *sym;
    pthread_mutex_lock(&find_lock);
    if (!libudev)  
        libudev = dlopen("libudev.so.1.6.4", RTLD_LOCAL   RTLD_NOW);
     
    sym = dlsym(libudev, symbol);
    pthread_mutex_unlock(&find_lock);
    return sym;
 

static void udev_enter(const char *func)  
    pthread_mutex_lock(&check_lock);
    assert (udev_running == 0   udev_thread == pthread_self());
    udev_thread = pthread_self();
    udev_func[udev_running] = func;
    udev_running++;
    pthread_mutex_unlock(&check_lock);
 
static void udev_exit(void)  
    pthread_mutex_lock(&check_lock);
    udev_running--;
    if (udev_running == 0)
    udev_thread = 0;
    udev_func[udev_running] = 0;
    pthread_mutex_unlock(&check_lock);
 

#define make_func(type, name, formals, actuals)         \
    type name formals                       \
    type ret;                       \
    static void *f;                     \
    if (!f)                         \
        f = udev_symbol(__func__);              \
    udev_enter(__func__);                   \
    ret = ((typeof (&name)) f) actuals;         \
    udev_exit();                        \
    return ret;                     \
     

make_func(struct udev *,
      udev_ref,
      (struct udev *udev),
      (udev))

# LD_PRELOAD=/usr/local/lib/libudevwrap.so Xorg 

$ git git://keithp.com/git/udevwrap