Path: utzoo!utgpu!jarvis.csri.toronto.edu!mailrus!ames!apple!lins From: lins@Apple.COM (Chuck Lins) Newsgroups: comp.sys.mac.programmer Subject: Re: Hashing.... Message-ID: <35109@apple.Apple.COM> Date: 28 Sep 89 22:38:06 GMT References: <4345@internal.Apple.COM> <1728@neoucom.UUCP> <9690@chinet.chi.il.us> <4434@internal.Apple.COM> Distribution: na Organization: Apple Computer Inc, Cupertino, CA Lines: 25 In article <4434@internal.Apple.COM> dowdy@apple.com (Tom Dowdy) writes: >In article <9690@chinet.chi.il.us> henry@chinet.chi.il.us (Henry C. >Also, for all of you people who've got it in your head to make the next >great compiler or scripting language or what have you, be sure to take a >look at the IntlTokenize() routine, which does much of the hard work for >you, in a Script Manager compatible way. A fun routines to call, everyone >should run out and call it today. You mean, that I can set up a tokenizing scheme where all the keywords and operators are translated into 'tokens', read the whole source file into a big buffer, pass the buffer to the tokenizer, and get back a stream of tokens/ identifiers (for the stuff that wasn't tokenized)? If this is so, I may very well have to write a routine tonight to do just that! Now all I have to do is understand the Script Manager documentation ;-) (I can see those flames coming now!) -- Chuck Lins | "Exit left to funway." Apple Computer, Inc. | Internet: lins@apple.com 20525 Mariani Avenue | AppleLink: LINS Mail Stop 41-K | Cupertino, CA 95014 | "Self-proclaimed Object Oberon Evangelist" I speak for myself and no one else.