Path: utzoo!utgpu!jarvis.csri.toronto.edu!mailrus!ames!apple!lins
From: lins@Apple.COM (Chuck Lins)
Newsgroups: comp.sys.mac.programmer
Subject: Re: Hashing....
Message-ID: <35109@apple.Apple.COM>
Date: 28 Sep 89 22:38:06 GMT
References: <4345@internal.Apple.COM> <1728@neoucom.UUCP> <9690@chinet.chi.il.us> <4434@internal.Apple.COM>
Distribution: na
Organization: Apple Computer Inc, Cupertino, CA
Lines: 25

In article <4434@internal.Apple.COM> dowdy@apple.com (Tom Dowdy) writes:
>In article <9690@chinet.chi.il.us> henry@chinet.chi.il.us (Henry C. 
>Also, for all of you people who've got it in your head to make the next 
>great compiler or scripting language or what have you, be sure to take a 
>look at the IntlTokenize() routine, which does much of the hard work for 
>you, in a Script Manager compatible way.  A fun routines to call, everyone 
>should run out and call it today.

You mean, that I can set up a tokenizing scheme where all the keywords and
operators are translated into 'tokens', read the whole source file into a
big buffer, pass the buffer to the tokenizer, and get back a stream of tokens/
identifiers (for the stuff that wasn't tokenized)? If this is so, I may very
well have to write a routine tonight to do just that!

Now all I have to do is understand the Script Manager documentation ;-)
(I can see those flames coming now!)


-- 
Chuck Lins               | "Exit left to funway."
Apple Computer, Inc.     | Internet: lins@apple.com
20525 Mariani Avenue     | AppleLink: LINS
Mail Stop 41-K           | 
Cupertino, CA 95014      | "Self-proclaimed Object Oberon Evangelist"
I speak for myself and no one else.