لوحة مفاتيح عربية
Ergonomic Arabic Keyboard Layout
This is work in progress and contributions are welcome. Head over to GitHub to see where you can help.
Other languages using the Arabic alphabet (regional dialects, Urdu, Persian) are explicitly not supported.
xmodmap ar-lulua.xmodmap28 letters make up the Arabic alphabet and quite a few extra symbols are required for proper text input, like the hamza in its different shapes أ إ آ ء ئ ؤ, ta marbutah ة, alif maqsurah ى and various diacritics for vowelized texts. Since the performance of a keyboard layout depends on the text entered it is necessary to study its mono-, di- and trigraph frequencies first. The novel corpus built for the following analysis consists of
| مصدر | كلام | حروف | |
|---|---|---|---|
| {{ c.source.name.ar }} | {% set count = c.get ('count') %} {% if count %} {# use new style formatting, for some reason %7,d does not work #}{{ '{:7,d}'.format(count.num)|arabnum }} {{ count.kind.ar }} | {% else %}{% endif %} {% set stats = c.get ('stats') %} {% for k in ('words', 'characters') %} {% set i = stats[k]|approx('ar') %} | {{ '%5.1f'|format(i[0])|arabnum }} {{ i[1] }} | {% endfor %}
| مجموع | {% for k in ('words', 'characters') %} {% set i = corpustotal[k]|approx('ar') %} | {{ '%5.1f'|format(i[0])|arabnum }} {{ i[1] }} | {% endfor %}
| Source | Words | Characters | |
|---|---|---|---|
| {{ c.source.name.en }} | {% set count = c.get ('count') %} {% if count %} {# use new style formatting, for some reason %7,d does not work #}{{ '{:7,d}'.format(count.num)|numspace }} {{ count.kind.en }} | {% else %}{% endif %} {% set stats = c.get ('stats') %} {% for k in ('words', 'characters') %} {% set i = stats[k]|approx %} | {{ '%5.1f'|format(i[0])|numspace }} {{ i[1] }} | {% endfor %}
| Total | {% for k in ('words', 'characters') %} {% set i = corpustotal[k]|approx %} | {{ '%5.1f'|format(i[0])|numspace }} {{ i[1] }} | {% endfor %}
The chosen Quran representation does not include all quranic diacritization symbols, like other datasets. This makes comparison fairer, since most keyboards presented below do not include any of them.
The plot below shows ا ل ي م و ن can be considered the most frequently used letters in the Arabic language. Together they account for more than 55% of all letters in the corpus.
Arabic letter frequency distribution
Throughout this evaluation color coding is used to identify fingers:
Asymmetry is defined as the difference between left and right hand button usage \(b_{left/right}\) and includes the thumb:
$$a = \frac{b_{left}}{b_{total}} - \frac{b_{right}}{b_{total}}$$The layout proposed uses four shift layers in a way inspired by Neo2. Thus it assumes a 102/105 key ISO keyboard common in Europe – but also available in Arab countries – to accommodate for the necessary shift keys. These are in order: Shift on the left and right, caps lock on the left and the rightmost key in the middle row, the key right to the left shift key and the key labeled Alt Gr to the right of the spacebar. Symbols are assigned to the four layers by their function: characters, punctuation, diacritics, other.
Apple, for instance, provides an Arabic hardware keyboard with this physical layout. But both variants, 101/104 key and 102/105 key devices, seem to exist in the Arab world.
The first layer was optimized using an extended reimplementation of carpalx. From several runs with 100.000 iterations each the layout which had good scores and looked reasonable to the human eye was picked. Afterwards the third layer was optimized using the same process, but only using data from the Hindawi corpus, because it is the only one with at least some fully diacriticised texts. Finally the different brackets were arranged by hand and the remaining symbols algorithmically distributed on the second layer using the raw Wikitext from the Arabic Wikipedia dataset.
This is a common way of arranging brackets, because most algorithms ignore human desire for symmetry.
The most frequent letters have all been assigned to the home row, which makes them easily accessible. ا and ل are typed with different hands, balancing the load on hands almost evenly. The index and middle finger of both hands share the majority of the typing load, but naturally the left middle finger is used more frequently due to its assignment to the letter alif.
The layout targets Quaranic and Modern Standard Arabic (MSA), also called Fusha (الفصحى), only. Dialectical Arabic (العامية) is mainly a spoken language, although with the rise of social media sites like Twitter and Facebook this is changing. For now however it’s not an optimization target due to the lack of a good, representative corpus.
Designing the layout to be compose-based has both benefits and disadvantages. Compose-based mainly means the hamza ء is treated like an optional diacritic for Alef, Waw and Yah instead of viewing Alef-Hamza, Waw-Hamza and Yah-Hamza as precombined, atomic units. Although أ and ا are not the same, the hamza can be dropped if the writer’s intention is unambigiously inferable from context. Thus it makes sense to provide hamza as a combining character on the keyboard. Additionally it uses two keys less than precombining it with its stems, allowing the entire alphabet plus hamza diacritic to fit on a single keyboard layer. However, there is a cost to this approach: All hamza variants account for {{ '%.1f'|format(layoutstats['ar-osx'].hamzaImpact*100) }}% of button combinations. Splitting hamza and from its stem means doubling the total number of button combinations and thus button presses, decreasing scores like words per minute (WPM) slightly. Splitting Alef and Alef-Hamza could also reduce pressure on left middle finger and allow for more even distribution, since {{ layoutstats['ar-osx'].hamzaOnAlef|fraction }}th of all Alef uses are with Hamza.
See for example section 3.3 of Buckwalter’s Issues in Arabic Morphological Analysis.
Examples:
{{ fingerhandstats(layoutstats['ar-lulua']) }}
This section explores existing keyboard layouts made for the Arabic language and analyzes their usability.
Trying to unify existing layouts, the Arab Standardization and Meterology Organization (ASMO), now part of AIDMO, published an Arabic keyboard layout in 1987 as standard 663 titled Arabic terminal keyboard layout. The layout has several shortcomings: Most notably it clusters letters by their visual similarity (ض ص، س ش، ح ج خ) and not frequency. Also it overuses the right index finger by assigning the four high-frequency letters ا ت و ة to it.
{{ fingerhandstats(layoutstats['ar-asmo663']) }}
Mac OS X’s Arabic keyboard layout makes a few small changes to ASMO 663 by moving the ة to a hard to reach spot on the right of the top row. It also moves the short vowels from the first to the top row of the second layer and replaces them with symbols. The bottom row keys are aditionally shifted to the right, beginning with ر.
{{ fingerhandstats(layoutstats['ar-osx']) }}
A more common layout is the one used on Linux, which also exists on Windows with minor changes to the first layer. While its top and center row barely differ from ASMO 663 the bottom row now contains a separate key for the ligature ﻻ, likely inherited from early typewriter layouts. But at the cost of pushing punctuation characters to the second layer, د into the top and ذ even further into the number row.
{{ fingerhandstats(layoutstats['ar-linux']) }}
In contrast to the layouts presented so far the following layouts claim to be optimized for the Arabic language and were, at least partially, created algorithmically.
One of the eariest accounts can be found in the article Statistical Distribution of Arabic Letters Aids to the Design of a New Keyboard by Al-Ramly et al published in 1980. The Arabic half of the proposed bi-lingual layout seems to be hand-optimized based on several metrics including character frequencies – without mentioning a source for them though – visual similarity (“letter groups”) and their position on previous layouts. It tries to balance load between hands, assign more work to index and middle fingers and place common letters in the home row. However the asymmetry given in the article, 0.032, cannot be reproduced here. For the most part the layout lacks combining and pre-combined characters, a task that is left to “machine intelligence” making it hard to use nowadays.
While the layout distributes load between fingers quite well it favors the left hand by assigning ا and ل to it. The decision to place ث in a very prominent spot seems weird, given it only accounts for 0.5% of all symbols, even in their own analysis.
{{ fingerhandstats(layoutstats['ar-alramly']) }}
Another article from the early days of computers published in 1990 is Design of Arabic Keyboard Layout Based on Statistical Properties of Arabic Characters by Idlebi et al. They present two examples of programmatically optimized layouts and account for character and bigram frequencies based on a corpus of 100.000 characters, finger movement time of unknown origin and finger load.
Unfortunately the results use 12 keys per row and are not suitable for use with current European keyboards, which usually feature only 11 keys in the bottom row. Thus the layout displayed below lacks the Arabic question mark and comma in the bottom right. Probably due to their unusual assumption that middle- and ring-finger rest in the top row their results are suboptimal, placing both ا and ي in the top row. Their analysis notices this and suggests improved positions for both characters, but these are not actually implemented. The big asymmetry is caused by placing ا ل ي and و, four of the five most frequent letters, on the right hand side.
{{ fingerhandstats(layoutstats['ar-idlebi']) }}
About 20 years later (2008) Malas et al. presented an alternative layout generated by a genetic algorithm in their article Toward Optimal Arabic Keyboard Layout Using Genetic Algorithm. They used a snapshot of the Arabic Wikipedia probably from around 2008 and optimized for typing speed only, claiming 35% faster typing compared to the currently used layouts. However the decision to put ي in the top row seems odd. Assigning the same left index finger to ا ي و, which are three of the most frequent letters, heavily strains this particular finger.
{{ fingerhandstats(layoutstats['ar-malas']) }}
In figure 8 of the paper A new optimal Arabic keyboard layout using genetic algorithm published in 2010 Khorshid et al. present yet another layout. They reject the idea of using contemporary text sources like newspapers or books and consequently their only input text is a copy of the Quran, whose distribution of mono- and digraphs is quite different from modern, non-religious texts. A 36% improvement over the standard keyboard based on their criteria for ergonomic layouts is claimed in their conclusion as well. However their algorithm seems to favor the bottom row instead of the easier to use top row since it places the letters ب ت ر there.
{{ fingerhandstats(layoutstats['ar-khorshid']) }}
In 2015 patent 9,041,657 B2 was filed in the US, presenting yet another computer-generated layout. Its genetic algorithm was seeded with just 54 Arabic e-books consisting of 7 million characters in total. Overall it claims to be 9% faster than default layouts. This layout rips off most of the standard layout’s second layer, but amusingly fails to include a question mark, while it does provide three single-quote marks ’ and two Arabic semicolon ؛. Additionally it places ي in an even worse position than Malas’ layout.
{{ fingerhandstats(layoutstats['ar-osman']) }}
The Arabic Phonetic Keyboard simply maps the QWERTY layout to Arabic letters, based on their sound. Thus Q becomes ق, Y becomes ي and so on. It claims to be optimized for writing vowelized texts, especially Quranic Arabic, and thus includes quite a few combining characters and special symbols. Although it claims to make frequently used letters easily available – based on the work of Intellaren – it makes no effort to arrange letters according to their usage frequency.
{{ fingerhandstats(layoutstats['ar-phonetic']) }}
While technically speaking not a layout but alternative input method, Intellark by Intellaren is worth mentioning. It is based on repeatedly pressing the same button to modifiy the current character. For example pressing A on the QWERTY keyboard cycles through the alternatives ا أ إ آ and ء. Obviously this is slow, error-prone and violates Dvorak’s guidelines for keyboard layout designs.