[libvoikko] Libvoikko compiled for Android

[Flammie Pirinen]

2012-08-23, Harri Pitkänen sanoi:

> ke 22.8.2012 17:26 Harri Pitkänen kirjoitti:
> > On Tuesday 21 August 2012, Flammie Pirinen wrote:
> >> Ok, I tried to test this with my minilaptop for now, and notice
> >> that there is another codepath in ZHfstOSpeller for legacy
> >> speller, the automatic test only tested the older Speller object.
> >> Should be finally fixed in r2626
> >
> > Thanks, I'll test this and if it works I'll update the binary test
> > package for
> > Android to have this support enabled.
> 
> It seems that legacy HFST format works correctly with libvoikko now.
> Thanks for that! The Android package will come soon.

Excellent work.

> But then I ran into another problem when comparing the results from
> HFST and VFST spellers. It looks like hfst-fst2txt is somehow broken
> at least when optimized lookup transducers are used as input. For
> Omorfi speller
> 
> $ hfst-fst2txt -D spl.hfstol | head
> 0       1       @C.AGREE@       @C.AGREE@
> 0       2       -       -
> 0       2       ‐       ‐
> 1       196922  @D.NEED@        @D.NEED@
> 1       196923  A       A
> 1       196924  B       B
> 1       196925  C       C
> 1       196926  D       D
> 1       196927  E       E
> 1       196928  F       F
> 
> Lines 2 and 3 are the same

Bug in your email client or mine reveals the difference quite nicely :-)

> and then there is no transition from
> initial state with label @U.NEED.NOMINAL@ which would be needed for
> some words (such as "aamu"). Thus "aamu" is not recognized with VFST
> speller. Similar issues break the Sami speller as well.

You might be right with optimized format printing here... I'll forward
the bug to tracker for now; I don't have enough experience of the
optimized format to solve this right off, but I seem to remember that
there are some special considerations for flags as with epsilons.

-- 
Flammie, computer scientist bachelor, linguist master, free software
Finnish localiser, and more! <http://www.iki.fi/flammie/>