Looking for a glossary split up script

Question

Level 1

10 points

Looking for a glossary split up script

Hello,

I'm a novice to AppleScript and I'm looking for a script that will be useful for me as a translator: a script to split up a glossary with source-side alternatives, separated by semicolons. As a matter of fact I'm not sure whether this is something that can easily be done with AppleScript or better should be handled with Perl or another solution.

This is how the glossary looks (TAB stands for the tabulator character):

Ethanol;Ethylalkohol;Äthanol;Äthylalkohol;Weingeist;Spiritus;Sprit;Alkohol;Hydro xyethanTABEthanol;ethyl alcohol;pure alcohol;beverage alcohol;drinking alcohol;CH3CH2OH;C2H5OH;C2H6O

Quarz;Tiefquarz;α-QuarzTABSiO2;quartz;citrine;rose quartz;smoky quartz;milk quartz;milky quartz

And this is how this UTF-8 text file should be rewritten:

Ethanol TAB Ethanol;ethyl alcohol;pure alcohol;beverage alcohol;drinking alcohol;CH3CH2OH;C2H5OH;C2H6O

Ethylalkohol TAB Ethanol;ethyl alcohol;pure alcohol;beverage alcohol;drinking alcohol;CH3CH2OH;C2H5OH;C2H6O

etc.

Quarz TAB SiO2;quartz;citrine;rose quartz;smoky quartz;milk quartz;milky quartz

Tiefquarz TAB SiO2;quartz;citrine;rose quartz;smoky quartz;milk quartz;milky quartz

α-Quarz TAB SiO2;quartz;citrine;rose quartz;smoky quartz;milk quartz;milky quartz

Thank you for any suggestions!

Hans

iMac, Mac OS X (10.6.2)

Posted on Jun 1, 2014 6:08 AM

Reply

Answer 1

Jun 1, 2014 11:51 AM in response to Hans Elting

Using awk, this should work for you:

awk -F'\t' '{split ( $1, a, ";" ); for (i=1; i<=length(a); i++) print a[i] "\t" $2}' FILE

Reply

Answer 2

Hans Elting Author

Level 1

10 points

Jun 1, 2014 1:00 PM in response to Mark Jalbert

Thank you very, very much, Mark!

Cheers,

Hans

Reply

Answer 3

Hans Elting Author

Level 1

10 points

Jun 2, 2014 12:13 AM in response to Mark Jalbert

Hello Mark,

The script works beautifully. I now have:

α-Quarz TAB SiO2;quartz;citrine;rose quartz;smoky quartz;milk quartz;milky quartz

If I want to split up the right side of the tab too, I could of course use a spreadsheet program and swap the columns. But that is a little clumsy, especially with large glossaries (500,000+ lines).

Would it be possible that you provide a script for 'the right side' too?

So that I'd get:

α-Quarz TAB SiO2

α-Quarz TAB quartz

α-Quarz TAB citrine

α-Quarz TAB rose

etc.

Many thanks in advance!

Hans

Reply

Answer 4

Hiroto

Level 5

7,467 points

Jun 2, 2014 6:17 AM in response to Hans Elting

test

edit:

I have not been able to post due to the following error:

Access Denied

You don't have permission to access "http://discussions.apple.com/post.jspa?" on this server.

And this simple "test" message appears to pass.

Will try to post the true message...

Message was edited by: Hiroto (added edit)

Reply

Answer 5

Hiroto

Level 5

7,467 points

Jun 2, 2014 6:21 AM in response to Hiroto

Failed again. 😟

Don't know why.

Gave up.

Sorry.

Reply

Answer 6

Hiroto

Level 5

7,467 points

Jun 2, 2014 8:28 PM in response to Hiroto

Last attempt to post.

perl -CSDA -w <<'EOF' - in.txt > out.txt
use strict;
while (<>) {
    chomp;
    my ($x, $y) = split "\t";
    my @xx = split ';', $x;
    my @yy = split ';', $y;
    for $x (@xx) {
        for $y (@yy) {
            printf "%s\t%s\n", $x, $y;
        }
    }    
}
EOF

- The in.txt can be either the original text or the "half-expanded" text by the previous awk script.

- Caution: if the original text contains 500K lines, this script will yield huge text file of 25M ~ 50M or more lines.

Regards,

H

PS. Hmm. This has passed. There seems to be some content filtering to determine whether to accept or deny the post request. As far as I can tell, U+0023 NUMBER SIGN, such as in shebang, lets the post be denied.

/H

Message was edited by: Hiroto (added PS)

Reply