tok problem. What is wrong with this string?

[Roman Mishin]

I am implementing a simple text case correction macro, and encountered strange/unexpected behavior:

Code:

Copy      Help

str text="UPDATE: THERE ARE THREE LEVELS OF HEAVEN. I DID NOT KNOW THIS WHEN TAKING THESE JOURNEYS. “A TALK WITH IMMORTALS” IS CLEARLY LEVEL TWO. “JOURNEY TO MY FATHER” I BELIEVE WAS LEVEL ONE. THE OTHERS, USE YOUR OWN JUDGEMENT."
ARRAY(str) Tokens Delims
tok(text Tokens -1 "" 0 Delims)
out Delims

this outputs:

Code:

Copy      Help

: 
 
 
 
 
 
. 
 
 
 
 
 
 
 
 
. 
 
 
 
 
 
 
 
. 
 
 
 
 
 
 
 
 ONE. THE OTHERS, USE YOUR OWN JUDGEMENT.
. 
 
, 
 
 
 
.

why " ONE. THE OTHERS, USE YOUR OWN JUDGEMENT." is a delimiter?

The whole string is a random excerpt from a book. It did not happen with other strings.

Quick Macros 2.4.8.0

[Gintaras]

Thank you. Fixed in version 2.4.8.2.

http://www.quickmacros.com/download.html