TextPipe makes working with text files easy - fixing websites, converting data
files, extracting from databases, fixing formatting, or
1001 other tasks.
New Multi-Processor support (in Server version) with
Filters\Special\Switch CPUs to direct filtering to different CPUs. This
enables massive performance enhancements for large data crunching tasks.
Revamped and Improved Mainframe Support:
Mainframe Copybook Wizard has been completely
re-written as a filter. The parser now shows the line number of any error,
handles INDEXED BY clauses, logs a warning if there is an invalid record at
the end of file, and has an XML output option. It also now handles
non-PIC style copybooks.
Usability Improvements:
Now detects Unix files being loaded into Trial Run area, and warns the
user and offers to add an End-Of-Line conversion filter
Comment filters are now shown in green italics to make the filter list
more readable
Tightened up the Analyze File Format function to correctly
identify BOM and DOS End-Of-Lines in files
TextPipe now highlights the filter in error correctly, taking into
account comment filters
Windows Vista installation support.
Advanced Stuff:
Fixed /Q exit on completion race condition which caused TextPipe to not
exit reliably. This only occurred when a new processing thread started and
finished before (!) the main thread processed the /Q command
An inability to log messages to the log file now causes a Windows Event
Log message
New macro @filterFilename to output the filter filename.
TextPipe.filterFilename is also available in the scripting filter.
...and about 30 other new options, changes, improvements and bug fixes (read
more below).
As always, TextPipe will read filters from ALL old versions without any
changes being required.
If you're a consultant and you don't want your clients to edit your filter,
use TextPipe's Run Time
Edition.
If you're an application programmer and want to embed TextPipe in your
application, see the
TextPipe Engine.
See also:
WordPipe - search
and replace Microsoft Word documents ExcelPipe - search and replace Microsoft
Excel spreadsheets DataPipe - search and replace database
records, including Microsoft Access and SQL Server PowerPointPipe - search and replace
Microsoft PowerPoint presentations
Detailed Changes Log
What's New in TextPipe v8.1.7 - July 19, 2008
=============================================
* Fixed problem loading replace filters from versions 7.8.3 and older with \@
or \$ in the replacement text.
What's New in TextPipe v8.1.6 - July 9, 2008
============================================
* Added new filter to Restrict to UTF-8 files.
What's New in TextPipe v8.1.5 - July 2, 2008
============================================
* Fixed bug with named parameters in search/replaces - if a subexpression was
not captured then any remaining named parameters would have no value and
corresponding global variables would not be set.
What's New in TextPipe v8.1.4 - June 24, 2008
=============================================
* Clipboard output now shows a non-zero size.
* Statistics are now reset correctly when a filter has subfiters.
* Copy to log button now correctly re-enabled when a job starts for the second
time.
What's New in TextPipe v8.1.3 - June 16, 2008
=============================================
* Improved internal patterns used by the HTML filter to prevent stack overflow
errors.
What's New in TextPipe v8.1.2 - May 27, 2008
============================================
* Fixed bug where /Q and /MINIMIZED were not recognised when placed in a /Z=
command file.
* Fixed bug where subfilters of Restrict to Matching lines were not called when
a count of matching lines was being output.
* Fixed discrepancies between docs, TextPipe and TextPipe Engine for
addSecondaryOutputFilter() function, output options and for filenames in the
File Grid.
What's New in TextPipe v8.1.1 - April 29, 2008
==============================================
* Fixed error using a Search/Replace action of 'Send variable X to subfilter'
when the previous replacement text had been set to '$0'.
What's New in TextPipe v8.1 - April 21, 2008
============================================
* Improved handling of non-DOS EOL files - TextPipe now checks if your filter
has an EOL Conversion filter before offering to add one for you.
* Link filters can now use a path relative to the current filters path
(previously this was relative to the TextPipe installation path). This makes
them far easier to link to.
* The Capture Filter now allows variable names containing digits.
* Globals can now be set on the command line using the syntax @name=value with
a space between each set of values.
What's New in TextPipe v8.0.9 - March 25, 2008
==============================================
* New extended logging for Remove Blank Lines, Remove Blanks from Start/End of
Line.
What's New in TextPipe v8.0.8 - March 18, 2008
==============================================
* New notice level message if MS Word or Excel files are processed using the
evaluation version.
* If Remove/Restrict Delimited Field filters remove fields from the end of the
line, TextPipe now removes any hanging delimiters.
* The Convert Excel files to Text filter now converts all sheets, not just the
first one.
What's New in TextPipe v8.0.7 - March 5, 2008
=============================================
* Zoned decimal conversions now allow positive and negative signs.
What's New in TextPipe v8.0.6 - February 20, 2008
=================================================
* When run from the command line, TextPipe now does not show a dialog on errors
such as a filter file could not be loaded. An exit code is set and the log
file written instead.
* Fixed a bug where the Analyse function on the Files Grid did not return a
result.
What's New in TextPipe v8.0.5 - February 14, 2008
=================================================
* Fixed a bug where the Copybook Filter used the wrong parser if PIC was
preceded by a tab instead of a space.
* Copybook Filter now copes with 'PIC GROUP' syntax.
What's New in TextPipe v8.0.4 - February 13, 2008
=================================================
* Capture filter can now resets at the beginning of the file, at the beginning
of each region or both.
What's New in TextPipe v8.0.3 - February 4, 2008
================================================
* Right-clicking a filter now shows a 'Help on this filter' link which quickly
takes you to the help file without needing to add the filter. Using
Help\Embedded Help also constantly updates to show you help on the current
filter.
* The Status tab is now displayed by default when filters are run from the
command-line or from Windows Explorer.
* Mainframe filters now insert implied decimals correctly when the fields are
blank padded.
* Folder overload prevention for the split filter now triggers at 1000 files
(was 10000).
What's New in TextPipe v8.0.2 - January 9, 2008
===============================================
* Now warns if the user tries to use the Trial Run area to process a Mainframe
Copybook (a file must be used).
* Task Menu filters now open a status window so that progress and/or errors can
be reviewed.
* The evaluation version (even an expired version) can now be used to check if
a filter is compatible with the Pro, Standard or Lite version.
* The Restrict to Filename filter (used to rename files on the fly) now skips
processing filenames inside zip/docx/xlsx/pptx files.
What's New in TextPipe v8.0.1 - October 30, 2007
================================================
* Fixed implied decimal inserted in wrong position for zoned decimal fields.
What's New in TextPipe v8 - October 24, 2007
============================================
* The Status Window now forms a new tab of the Filter Window - making it easier
to refer to results. The results log is now also far easier to read.
* The Mainframe Copybook Filter (new) and Wizard (deprecated)
- now handle OCCURS without TIMES when the repeating field is an unnamed PIC.
- now handle masks like PIC 9999/99/99 - these are treated just as an Alpha
field, in this case, PIC X(8). No mask substation is performed.
* The Mainframe Copybook Filter now generates numbered field names when the
fields are inside a repeated group. This wizard does not do this, but the
field header can be manually edited.
* Improved the EasyPatterns CSVfield, TABfield, PipeField, HTMLtag,
HTMLstartTag, HTMLendTag, QuotedString so that they are much faster.
What's New in TextPipe v7.9.11 - October 24, 2007
=================================================
* Fixed bug with Search/Replace in Exact mode, if the Action was set to
'Remove', the text was not actually removed.
* Added collection and logging of statistics to Lite and Standard editions.
What's New in TextPipe v7.9.10 - October 19, 2007
=================================================
* Log filenames are now displayed with an absolute path to make them easier to
locate. When [Copy Lines to Log File] is clicked in the Status Window, now
ALL lines are copied.
* Fixed handling of invalid .zip files.
* Convert MS Word/Excel documents to text - better handling of MS Word/Excel
failures.
* Improved status dialog with single tab display.
* Log files now combine date and time into single field.
What's New in TextPipe v7.9.9 - October 8, 2007
===============================================
* Fixed output of implied decimal values for Mainframe Copybook conversions.
What's New in TextPipe v7.9.8 - September 27, 2007
==================================================
* Fixed binary file detection logic.
What's New in TextPipe v7.9.7c - September 18, 2007
===================================================
* Fixed handling of last file in compressed Office 2007 formats (docx, xlsx,
pptx).
What's New in TextPipe v7.9.7b - September 12, 2007
===================================================
* Fixed script generation for addUnicodeConversionFilter2.
* Fixed COM function TextPipeFilter.compiledFilterStartJob.
* Grep functions can now match blank lines using the pattern ^$.
* Fixed Copybook Filter choosing incorrect parser if 'pic' used rather than
'PIC'. Copybook Filter now accepts field names that include spaces. Parse
tree output now includes periods so that it is still a valid copybook. Fixed
field width for P (Packed) type when using alternate style copybooks.
What's New in TextPipe v7.9.7 - September 4, 2007
=================================================
* The File Input's Binary detection now correctly identifies Unicode files, Zip
files and Microsoft Office 2007 file formats (.DOCX, .XLSX, .PPTX) as non-
binary.
What's New in TextPipe v7.9.6a - August 29, 2007
================================================
* Debug Mode of Copybook Filter now shows field length and start and stop
columns. Copybook Filter now handles OCCURS after the PIC definition.
* New internal editor for reviewing text files.
What's New in TextPipe v7.9.6 - August 24, 2007
===============================================
* Zip files - now processes and updates data stored inside compressed files
such as .zip, and Microsoft Office 2007 file formats such .DOCX, .XLSX, .PPTX
etc.
* Word conversion filter now clears previous results in case of error, and
disables macros during run.
* Removed 64k limitation on string data saved to registry, fixed error with
string data over 64k not being allowed.
What's New in TextPipe v7.9.5 - August 10, 2007
===============================================
* Fixed Width Wizard now accepts both
and
-
formats.
* Now uses updated pattern match library to resolve regex problems.
What's New in TextPipe v7.9.4 - August 1, 2007
==============================================
* New status window option to Delete backup files (in addition to restoring
backup files). Status window now warns you if you attempt to close it before
dealing with backup files.
* Better warning message for invalid file patterns in the Files to Process
grid.
* Copybook REDEFINE clause now allows an optional trailing period.
What's New in TextPipe v7.9.3 - June 22, 2007
=============================================
* New Word Concordance filter under Filters\Convert.
* New filter Restrict to Blocks of Lines - useful for adding text after every
XX lines.
* Reinstated Filters menu for accessibility, and File Menu items Link to
Filter, Insert a Filter, Search for a filter.
* Refined the pattern generated by filter Restrict to Between Tags.
* Script filter now works with PerlScript engine - all function validation is
disabled.
What's New in TextPipe v7.9.2 - June 12, 2007
=============================================
* Added semi-colon (;) as an output format for the Mainframe Copybook Wizard
and Fixed Width Wizard.
* Added error for blank text in the Mainframe Copybook Filter.
* Fixed incorrect length detection for signed zoned decimal in the Mainframe
Copybook Wizard (the Copybook Filter used the correct result).
* Reinstated wizard on startup.
What's New in TextPipe v7.9.1 - May 31, 2007
============================================
* Fixed pattern generated by filter Restrict to Between Tags.
* The default filter Normal.fll is now loaded from the Documents folder
regardless of which folder TextPipe is started from.
* C:\ is now not used as a temporary folder, instead it is requested from
Windows.
* Maps are now retrieved from the Documents folder.
* Code page functions are now unavailable under Windows NT.
* New prompt for language on first run.
What's New in TextPipe v7.9 - May 28, 2007
==========================================
* New Multi-Processor support (in Server version) with Filters\Special\Switch
CPUs to direct filtering to different CPUs. This enables massive performance
enhancements for large data crunching tasks.
* Vista install support.
* Now detects Unix files being loaded into Trial Run area, and warns the user
and offers to add an End-Of-Line conversion filter.
* Mainframe Copybook Wizard - fixed incorrect implied decimal.
- has been completely re-written as a filter. The parser now shows the line
number of any parse error, handles INDEXED BY clauses, logs warning if
invalid record at end of file, XML output option.
- now handles non-PIC style copybooks
* TextPipe now highlights the filter in error correctly, taking into account
comment filters.
* New macro @filterFilename to output the filter filename.
TextPipe.filterFilename is also available in the scripting filter.
* Comment filters are now shown in green italics to make the filter list more
readable.
* Fixed pattern generated by filter Restrict to Between Tags.
* An inability to log messages to the log file now causes a Windows Event Log.
* Tightened up the Analyse File Format function to correctly identify BOM and
DOS End-Of-Lines in files.
* Fixed intermittent /Q Exit On Completion switch. This only occurred on fast
CPUs when a new processing thread started and finished before (!) the main
thread processed the /Q command.
* Fixed EasyPattern bracket optimization. Now shows the line number of any
error, and fixed [PhoneNumber] pattern.
* Fixed Perl/EasyPattern exception with named captured variables and Prompt on
Replace was turned on, when the named captured variable did not match
anything.
* Removed remaining memory Info log item on Merge Sort.
What's New in TextPipe v7.8.13
==============================
* Mainframe Zoned Decimal expansion now allows negative to be coded with '2' or
'5'.
* Comment and Scripting filters now get display of special characters turned
off by default.
* Mainframe Wizard now removes the trailing delimiter on the last field.
What's New in TextPipe v7.8.12
==============================
* Explorer Context Menu now shows the filename without the extension.
* Convert Excel to CSV filter now does not use a TEMP file in C:\
* Mainframe Copybook Wizard now
- correctly discards INDEXED BY statements.
- removes the FILLER header associated with removed FILLER fields.
- VALUE lines are now ignored rather than causing a warning.
* Windows from TextPipe.Alert calls now allow the filter to be cancelled.
What's New in TextPipe v7.8.11
==============================
* Fixed bug with handling of Replace Action of 'Send $x to subfilter'.
* Fixed bug with HTML filter removing the Restricted text.
What's New in TextPipe v7.8.10
==============================
* New 'Action' field for Search/Replaces, with the default being just
'Replace', as before. The new field allows the matched value to be Removed,
to be sent to subfilters, or send just part of the matched value, such as $1-
$9. It also allows NON-matching text to be subfiltered, making it very easy
to process text outside bracketed expressions like
* New Output Filter options:
- Only Output Modified Files has been extended to allow the original files to
be deleted if they have been changed. This is very useful for repeated
processing of files to different output folders.
- Ignore Initial Folder - when the folder structure is being maintained, this
allows the start folder to be removed from the destination folder name.
* EasyPatterns now support named capturing using the syntax:
[ capture( ... ) as 'VarName' ]
* Optimized the Head/Tail filter when Including Bytes from the End of a file.
* The Filters Remove Lines From List and Extract Lines From List now do not
recognize special characters such as \. This is so that lists of filenames
with backslashes can be pasted in.
* File Grid 'Ignore' option renamed to 'Disable'. File Grid now allows files to
be excluded by perl regex pattern or EasyPattern.
* Replace List filter now allows Find/Replace strings to be Swapped, and the
list to be reversed - very useful if you apply changes to your data and then
reverse them at the end of the filter list.
* Fixed bug with the Restrict to Filenames Matching Pattern filter
- the filename was not being passed to subfilters, so double-level
filename restrictions did not work
- the patterns were incorrectly unescaped before being parsed, so
patterns with backslashes were not correctly interpreted.
* If too much data is sent to the Clipboard, TextPipe now traps the error and
limits the text to 10MB.
* Fixed bug with Restrict to Lines in Pattern list - the patterns were
incorrectly unescaped before being parsed, so patterns with backslashes were
not correctly interpreted.
* Added scripting functions TextPipe.fullOutputFilename, TextPipe.FilterWindow,
TextPipe.Application.
* Added COM functions FilterWindow.Application, FilterWindow.outputFileCount,
FilterWindow.outputFile() and FilterWindow.outputFileTask().
* Now warns against CSV or Tab data containing ASCII 26 when converting to XML
(remove or change using a map or Search/Replace filter).
* Fixed EasyPattern for [EmailAddress].
* Updated Extract\Email addresses filter.
* Fixed bug in Match Between HTML tags - Match Case was being set to On rather
than using the displayed setting.
What's New in TextPipe v7.8.9
=============================
* Increased maximum stack size to eliminate Stack Overflow errors.
* Fixed bug in Capture Text filter where the new captured value was only set at
the end of a file.
What's New in TextPipe v7.8.8
=============================
* Processing is now suspended when you hit [Cancel].
* Added TextPipe.exe path to Run... path.
* Fixed bug - the Mainframe Copybook Wizard no longer tries to replace
delimiters in the input file. It was replacing delimiters even inside packed
decimal fields.
What's New in TextPipe v7.8.7
=============================
* Fixed parsing of replace expressions including \x24 (a $ sign).
* Mainframe Copybook Wizard new options - Remove Filler fields, Include header.
The Wizard now records option settings in the Comment output.
What's New in TextPipe v7.8.6
=============================
* Fixed sort function not working when start column <> 1 and length < 4096.
* Extract email addresses now ignores '&'.
What's New in TextPipe v7.8.5
=============================
* Loading a search/replace list from Microsoft Excel now allows Unicode values.
* The grep filter now always reports the output file as being 'modified',
preventing confusing behaviour with the 'Only output modified files' Output
Filter option. A change of filename from input to output now also results in
a file being written, regardless of any changes.
What's New in TextPipe v7.8.4
=============================
* Mainframe Copybook Wizard now handles PIC fields both before and after OCCURS
xx TIMES for single field OCCURS statements.
* Optimized tree updating as field data is changed.
* Changed install paths for Windows Vista.
What's New in TextPipe v7.8.3
=============================
* New internal function TextPipe.finishedWithFile() to halt any further reading
of the current input file.
* New TextPipe.Application function isBinaryFile() to detect if a file is
binary or not.
* Updated memo editor and pattern matching engine to fix bugs in third-party
components.
* Fixed EasyPattern handling of EBCDIC() function.
* Fixed hex dump filter outputting the last line twice.
* Fixed handling of Compress to EBCDIC Packed Decimal.
* Fixed bug converting old replace patterns of form $1$2$3 to new form of
$1$$2$$3.
What's New in TextPipe v7.8.2
=============================
* New filter to Add a Line at a given line number.
* Fixed bug with EasyPatterns not returning all of a captured expression.
* Unicode conversion filter now makes use of the 'error' character.
* Mainframe copybook filter now copes with INDEXED BY statements, and better
handles nested OCCURS.
What's New in TextPipe v7.8.1
=============================
* Escaped Unicode now outputs \uXXXX instead of \u+XXXX.
What's New in TextPipe v7.8
===========================
* New option to show special characters such as spaces, tabs and line feeds.
* New option - triple-clicking a line selects the whole line.
* New filter to convert Filters\Convert\UTF16-LE to Escaped Unicode (ASCII +
UCN \U) e.g. \u402d\u403d
* The file list can now contain http://, ftp:// and gopher:// urls to download
directly.
* The user is now given the option to manually start Word or Excel if they are
not running when TextPipe needs them (with the Convert Word/Excel Document to
Text filters).
* Pattern matches can now name captured variables for use in the replacement
text e.g. searching for (?P\d+) would then allow the macro @dollars
to be used in the replacement, and also as a global anywhere else in the
filter list.
* Far more complex patterns can be processed, with support for up to 99
captured variables, from $1-$99.
* New 'File\Send to...' function for filter lists.
* New Fixed Width to Delimited Output wizard - makes converting fixed width
files to CSV, Tab simple.
* Mainframe Copybook Wizard now allows underscores (_) and single quotes (') in
field names in 'XXX_XXXX 4 AN 1-4'-type copybooks.
Wizard now removes the content of fields called FILLER*.
Wizard now copes with repeated single-fields, as well as GROUPED OCCURS.
EBCDIC packed decimal fields can now have either a leading sign, trailing
sign or no sign.
New option to trim leading spaces and zeroes from fields.
New option to only expand numeric fields - Alpha fields are left unchanged.
This is useful when the target application can accept EBCDIC data but can't
handle packed decimals.
New option to allow COMP-3 to be unsigned.
Wizard can now cope with removing line numbers and commented copybook lines
(those with a '*' in column 7).
Wizard can now cope with field definitions spread over multiple lines.
Wizard now remembers settings between uses in a single session.
Expand Binary Number to EBCDIC filter now outputs a fixed width result.
Expand Unsigned EBCDIC filters now output a space for invalid digits A-F.
* EasyPatterns now produce optimized perl regex output. Added EasyPattern
EBCDIC('') for matching EBCDIC values. Fixed parsing error with ASCII()
function. Now handles back references to groups 1-99. Fixed DayNumber
insisting on leading zero. EBCDIC() and ASCII() functions can now be used in
conjunction with not ... as character classes.
* Hex displays now all use '.' to replace space.
Query replace window now shows hex offsets for Hex Dump display.
* Convert Word Document to Text/Convert Excel Spreadsheets to Text now support
Unicode output as an option. Follow this with Convert UTF-16 to UTF-8 to
process these files using normal filters.
* New File Shred filter to completely overwrite file contents. Run repeatedly
for more shredding.
* Unicode property tables for pattern matching updated to Unicode 4.1.0, and
matching engine updated to PCRE 6.4.
* Split filter now can split at a pattern.
New Split Filter option to avoid overloading directories. When more than
10000 files are created, TextPipe starts a new folder.
Fixed bug where \\ could appear in split output filename.
* Filter list tree now auto-scrolls.
Filter list tree now allows mass enable/disable of filters with select and
right-click.
* New Filters to Add File Headers/Footers. Unlike the existing Header/Footer
filters, these filters only output once per file even when included inside a
restriction.
* Now can drag and drop filters between filter lists in different windows.
* Filters Add Header/Footer/Left Margin/Right Margin now always check for
@macros embedded in the text, regardless of whether the text comes from the
memo or an external file.
* Fixed bug with search/replaces where an internal conversion from ansi to
Unicode and back could result in high-ansi characters not being mapped
correctly back to their original characters. In particular, the ansi (tm)
symbol mapped back to TWO characters.
What's New in TextPipe v7.7.4
=============================
* @macros are now allowed in the replace field of a search/replace.
Note: If you load a filter from an older version, '@' will be escaped to
'@@'. The Confirm Replace dialog now shows the values of all global and user-
defined @macros.
* Warning for Excel or Word documents now disabled.
* Fixed Seller's Edit Distance search/replace not working.
* Fixed bug in Mainframe Copybook Wizard for length of signed Packed Decimal
fields.
What's New in TextPipe v7.7.3
=============================
* No longer deletes current output file when processing is cancelled and the
file is being appended to.
What's New in TextPipe v7.7.2
=============================
* TextPipe now works with DataPipe successfully.
What's New in TextPipe v7.7.1
=============================
* To prevent accidental overwriting of files, the default path for the Output
Filter's Single File Output, and the Merge Filter path are now set to blank.
* Removed the support for quoted tab data. Tab data does not need quotes!
* Fixed error with deleting filters.
* Fixed error entering custom delimiter when '\t' was entered.
What's New in TextPipe v7.7
===========================
* Ultra-fast sorting of huge files (100MB in less than 30 seconds); control
over maximum memory used - for shared servers.
* Convert Excel spreadsheets to CSV format.
* Control which filters are applied to which file types with the new Filename
Restriction filter - apply filters to say *.doc files, or *.xls etc.
* Handle more types of Mainframe data than ever before, with the improved
Mainframe Copybook Wizard:
- discarding line numbers from pasted copybooks
- now handles null packed and zoned numeric fields
- now outputs invalid digits in packed or zoned numerics as their hex
equivalents
- now adds filters to trim leading and trailing space from fields, and
leading '+' signs from numerics
- can now choose output format between Fixed, CSV, Tab- and Pipe-delimited
- now can add leading zeroes to numeric fields where the implied position is
greater than the field width
- output format now includes a record header, which makes it far easier to
validate the output file and import the file into a database
- new filters for unpacking odd/even-length unsigned packed numerics, and for
decoding overlapped unsigned packed numerics
- delimiters are removed from the input file first to prevent extra fields
being created.
* Easily Extract Text Between Delimiters with the new Web-based Filter Wizard.
* Review results easily
- New Output Filter option to open the output file on completion.
- Open output files easily with clickable links in the Status Dialog.
* Set the Error Character for Unicode and Code Page conversions when there is
no appropriate character in the target encoding.
* For precision automation, control TextPipe's pause before exit with the new
/Q=millisecond option.
* Accept pasted Unix text in the Search/replace filter.
* Easily match day names, day numbers and arbitrary characters using the new
EasyPatterns [dayname], [daynumber] and [ascii()] function which inserts
arbitrary ASCII codes in hex (eg $ff) or decimal (e.g. 255) format.
EasyPatterns now accept counts and quantities in either hex or decimal
format.
* Numbers lines across files, with the 'Don't Reset At End Of File' option of
the Line Numbering filter.
* Count occurrences of all lines, with the 'Include Counts Of 1' option of the
Count Duplicate Lines filter.
* Debug the output files of External programs using the 'Remove Output Files on
Completion' option of the Execute Program Filter.
* Store arbitrary text in the Scratch Pad - new Edit\Preference option.
* Date and time macros now return consistent results across different
localities -
@time - Inserts the time in the format HHMMSS
@date - Inserts the date in the format YYYYMMDD
@datetime - Inserts the date and time in the format YYYYMMDDHHMMSS
* When the right-click menu 'Save' option is selected, TextPipe now saves the
text exactly as is without interpreting special characters.
* TextPipe now prompts if you try and exit while a thread is running, and asks
for confirmation if you click [Cancel].
* When a list of perl patterns is loaded or used, TextPipe now shows the line
number of any error when a pattern parsing error occurs.
* The grep form's context menu now displays EasyPatterns or perl patterns
according to the pattern type selection.
* When new filters are added or duplicated they become selected. New filters
are now added with blank fields, and for the Search/Replace filter, the extra
options are set to defaults. After deleting a filter, the next filter is now
selected.
* The Options panel of the filter tree now scrolls to display buttons that are
not visible.
* Better handling of files that are missing or open in another process.
* Fixed Range Check error with optimization of 1:1 maps.
* Fixed Single File Output - didn't force creation of folders for output file.
* Fixed Windows Explorer shell extension - was starting the filter one row down
from the correct one.
* Fixed bug where Extract URLs filter would miss a URL on the very last line.
* Fixed merge sorting bug (only for very large files) where processing never
ended, and duplicates were not removed.
What's New in TextPipe v7.6.3
=============================
* New macro @fullOutputFilename. May be blank if the clipboard is being
processed.
* Fixed deadlock between threads that was slowing down the processing when the
TextPipe.Application object was called from code.
* Fixed Windows Explorer Content Menu not appearing.
What's New in TextPipe v7.6.2
=============================
* Fixed bug with grep filters where Match Case option was not recognised.
* Standardized help text and labels for grep filters.
* Fixed bug with conversions between ANSI and ASCII.
* Fixed bug with delimited field parser when it encountered a ' or " in the
middle of the field.
* Fixed bug with clipboard button not being acted on correctly.
What's New in TextPipe v7.6.1
=============================
* New filters to Restrict to ANSI files, and Restrict to Unicode UTF16 files
and Unicode UTF32 files. These are exceptionally handy for only converting
ANSI files to Unicode, or only converting Unicode files to ANSI.
* New filter to convert PDF documents to text format.
* Menu re-organization: Email menu replaced by new Extract menu, encodings
moved to Convert menu. 'Retain...' items renamed to 'Extract...'.
* New macros @randomdigit and @randomletter - very useful for generating test
data or for generating random sort keys.
* New Explorer extension option to Analyse files - detect if they are Unicode,
ANSI, etc.
* Reverse File performance improvement.
What's New in TextPipe v7.6
===========================
* New Unicode filters for Upper case, Lower case and Title case.
* Speed improvements for handling very large files.
* New Expand All/Collapse All menu on All Filters view.
* New scripting function to build filters to convert a Mainframe Copybook.
Copybook wizard now inserts a warning for each unidentified field, making
incorrect fields easy to identify.
* New warning message if no files were found to process.
* Filters\Convert\Numeric HTML entities To Text filter now converts output
characters to UTF-8. The resulting text can then be converted from UTF-8 to
UTF-16 for display.
* Menu items for common grep and conversion filters in the Wizard menu. Wizard
menu now is always expanded.
* Memo and text fields now use the fixed width font.
* Unicode and code page conversions now do not load the entire file into
memory, they convert the file progressively.
* Updated Simplified Chinese translation.
* Help text added to the Unicode/Code page conversion filter.
* Moved Hex and HTTP encode/decode to the Convert menu.
* Fixed pasting of text into a memo's Find window.
What's New in TextPipe v7.5.1
=============================
* Drag and drop now prevents nodes being dropped on filters that do not support
subfilters.
* Unicode replacement now reverses the order of Match Case to be correct.
* Reverted help system to old style.
What's New in TextPipe v7.5
===========================
* New Restrict to lines from list/lines NOT from list and
Restrict to lines matching pattern list/lines NOT matching pattern list.
New Match Case option for these filters too.
* EasyPatterns for Month and MonthName now do not automatically capture.
* Mainframe Copybook Wizard now copes with OCCURS where the number of
repetitions is fixed.
* New filter to convert numeric HTML entities to text e.g. ·
. New
maps to convert text to decimal or hex HTML entities.
* /CLEARFILTERS now removes all filters except the Log, Input and Output
filters. This retains the default settings from normal.fll
* /EXTENSION can now be set to blank to disable changing the extension.
* Fixed Access Violation processing empty result sets.
* Fixed load file list function.
What's New in TextPipe v7.4.3
=============================
* Now shows all available filters in a separate tree - these can be drag and
dropped or double-clicked to move them into the filter tree.
* Fix to Mainframe copybook filter to allow it to recognise field names that
included digits followed by ' A'.
What's New in TextPipe v7.4.2
=============================
* Fixed bug with Unicode exact match and Unicode pattern match where extra
characters were being output.
What's New in TextPipe v7.4.1
=============================
* Fixed bug with Unicode exact match and Unicode pattern match where search
terms were not found.
What's New in TextPipe v7.4
===========================
* Mainframe copybook wizard is now more flexible in the data it matches, and
handles COMP-3 field types, and handles numeric fields with purely decimals
(eg V999).
* New filters for code page conversion.
* New filters for Unicode Compose and Decompose:
NFC - Canonical Decomposition, followed by Canonical Composition
NFD - Canonical Decomposition
NFKD - Compatibility Decomposition
NFKC - Compatibility Decomposition followed by Canonical Composition
And Canonical Compose.
* Now supports Unicode command line parameters.
* Now supports single quoted CSV data, quoted tab data, and backslashes in
quoted CSV or Tab data. Existing text delimiters are now preserved on
conversion between CSV and Tab formats. The EasyPattern [tabfield] can now
match quoted tab data.
* The Restrict to HTML filter can now set the maximum match size - to match
very large sections of HTML or XML.
* Clarified examples in perl pattern right-click menus.
* Speed optimization for interactive search/replace when [Replace Job] chosen.
* When files are dropped, TextPipe defaults files to 'no subfolders'.
* Simplified the Trial Run button - now it only performs a trial run, and does
not toggle back to the Filters to Apply tab.
* XSLT filter now correctly flags modified text - so output files get created
when the 'Only Output Modified Files' flag is set. XSLT filter now reports
the error code and error reason to the log if an error occurs.
* Run External Program filter now reports in the log if the external program
has a non-zero exit code. The output file handle is now released on error.
* The Unicode Map filter's 'Replace With Value' string now supports special
characters.
* Encode Hex filter now does not add line feeds.
* Right-click option Show Hex Dump now checks if the underlying field is
Unicode or not before displaying data. A toggle between UTF16-LE and UTF16-BE
is also available.
* Reduced memory requirements of Database filter when SELECTing data sets.
* Fixed database filter's handling of VarBinary (BLOB) data.
* Database filter now handles subfilters correctly for encoding VarBinary data.
* Fixed bug when referencing a CSV or Tab search/replace list where the
replacement text was missing. A new error message now provides the line
number of any errors.
* Fixed bug with inserting captured text as an HTML table row, and added the
ability to insert as an XML record.
* Fixed bug with HTML help crashing TextPipe on exit.
* Fixed bug with Input Filter, Prompt On Binary files setting, if 'No To All'
was chosen TextPipe skipped ALL remaining files, not just binary files.
* Fixed Unicode display of extended information in the Prompt on Replace
dialog. Note: Unicode patterns do not support capturing- only $0 works.
* Fixed Map filter not detecting Reset and Clear changes.
* Fixed help file opening twice when F1 pressed.
* Fixed mismatch of 16 and 32-bit Unicode strings when converting from ANSI or
ASCII/OEM to Unicode and between code pages.
What's New in TextPipe v7.3.1
=============================
* Restored registry settings required by Offline Explorer.
* Changed default for re-loading previous filter to Off.
* Better exception handling for XSLT filter.
What's New in TextPipe v7.3
===========================
* New Mainframe Copybook wizard makes it incredibly easy to build a filter to
process mainframe data. Handles packed, zoned, binary and display field
types.
* New filters to Expand Binary Number To ASCII and Expand Binary Number To
EBCDIC.
* Global dialogs now make use of popup menus to insert special characters etc.
What's New in TextPipe v7.2.1
=============================
* New filter to capture text to a global variable. This is much faster than
using the Script filter to capture and then output text - which is the most
common use of the Script filter.
* New grid component for the Map filter - now supports far better range and
mouse selection.
* New option to automatically reopen the last filter.
* The Replace Query dialog now has an extra tab to show a hex dump of the found
text. This can be useful for debugging.
What's New in TextPipe v7.2
===========================
* Right-click menu for Replace field now provides easy insertion of captured
data as Tab or CSV-delimited fields or HTML.
* The Prompt On Replace dialog now displays the length of each captured
expression.
* EasyPatterns 1.9.1 - added [PipeField] and [Pipe] keywords.
* Fixed error when manually choosing the Skip option to not replace text in a
DBCS file - more than one character was added. Only occurs under DBCS
versions of Windows (eg Chinese).
* New error message when there are too many capturing expressions in a pattern.
* Fixed bug with 'First row is header row' not being recognised for processing
delimited data with embedded carriage returns.
What's New in TextPipe v7.1.7
=============================
* Added short cut menu items for converting between Unicode/ANSI and
Unicode/ASCII.
* Added line number and offset properties to the TextPipe object available in
the scripting filter.
* Map filters now have a comment property to describe what they are doing.
* EasyPatterns 1.9 - added keywords for [number, numbers, leftAngle,
rightAngle, lessThan, greaterThan ]
* Fixed restriction filters not supporting Secondary Output filters properly.
* Fixed exact match filter not properly supporting Extract option, and not
correctly handling text when 'Skip' was chosen.
What's New in TextPipe v7.1.6
=============================
* Search/replace lists now detect inserts, deletes and moves as changes. The
order of moved rows is now retained.
* Fixed restriction filters not supporting Secondary Output filters properly.
* Fixed EP keywords for [CRLF], [DOSNewLine], [EmailAddress] and [Hyperlink]
* Fixed width font for Trial Run Input/Output is now correctly loaded.
What's New in TextPipe v7.1.5
=============================
* EasyPatterns now allow repetition to be specified using the forms [2..3 ...]
and [2-3 ...] in addition to [2 to 3 ...].
* Right-click menu item Escape Special Characters now works for EasyPattern
fields.
* Fixed format string error on filter export.
* Fixed Search/Replace list -caused an error when it was opened.
* Fixed Remove Byte Order Mark (BOM) filter when handling UTF-8 files.
What's New in TextPipe v7.1.4
=============================
* Added right-click menu to EasyPattern fields to make designing patterns
easier.
* Added Line, Column and Length indicators to Search/replace filter.
* A warning is now shown for trailing whitespace in the search text, which
often results in the text not being found.
* Added 5 second countdown before TextPipe exits due to /Q command line
parameter.
* Greatly improved performance for massive numbers of files- TextPipe no longer
checks for duplicate filenames.
* Fixed EasyPattern for [month,monthnumber,day,hour] so that they match the
long version of the pattern first, then try the shorter variations.
* Fixed range check errors with Compress packed/zoned decimal filters.
What's New in TextPipe v7.1.3
=============================
* Fixed EasyPattern for [word] - previously matched non-word characters.
* Fixed EasyPattern - '.' was not escaped - now fixed.
* The Prompt On Replace dialog now shows the perl equivalent to an EasyPattern,
for verification purposes.
What's New in TextPipe v7.1.2
=============================
* Fixed access violation with changes to the Restrict to Bytes filter.
What's New in TextPipe v7.1.1
=============================
* Improved Restrict to Bytes (Byte x to End-y) to handle unlimited amounts of
data
What's New in TextPipe v7.1
===========================
* You can now set the field delimiter for the Restrict To Fields, Copy Fields,
Move Fields and Delete Fields filters. This opens the way for semi-colon-
delimited, #-delimited, !-delimited, ^-delimited and other bizarre data
formats.
* Added two new filters for compressing mainframe EBCDIC data to Packed Decimal
and Zoned Decimal formats.
* The Split filter can now set the first filename number.
* Added new Insert Bytes filter to complement the Insert Columns filter. This
new filter disregards line feeds when it adds text, and is very useful for
inserting commas into EBCDIC text as the text is converted.
* New documentation links in the Filter Menus.
* Synchronized scrolling is now properly restored when a filter is loaded.
* EasyPattern fixes to align with the EasyPattern documentation
- [symbol, symbols] - removed the '!'
- [space, spaces] changed to just matched ASCII 32, not tabs, line feeds etc
- [horizontalwhitespace, hspace] - now only match space and tab
- [verticalwhitespace, vspace, worddelimiter, linedelimiter,
paragraphdelimiter] - now match formfeed
- [anybracket, anybrackets] - now match { and }
* EasyPatterns now will NOT attempt to combine OR'd negated and non-negated
character sets, such as [ not lineChar or 'a' ]
* HTML filter now matches tags when the tag name is immediately followed by a
tab or newline, not just a space.
What's New in TextPipe v7.0.8
=============================
* Fixed EasyPattern handling of vertical tab (\v), which affects the keywords
verticaltab, verticalwhitespace, vspace, worddelimiter, wordchar,
columndelimiter, columnchar, linedelimiter, linechar, whitespace, word, line,
and column. This problem still exists in the perl pattern library, and can be
worked around by using \x0b instead of \v.
What's New in TextPipe v7.0.7
=============================
* Expand Zoned Decimal and Expand Packed Decimal filters are no longer added
inside a Restriction filter.
* Changed EasyPatterns for EmailAddress, HyperLink, PageNumber and DayOfYear so
that the constituent parts are captured into $variables for later
substitution.
* Fixed EasyPattern for FormFeed.
* Fixed handling of EBCDIC negative zoned decimals.
What's New in TextPipe v7.0.6
=============================
* Fixed bug with parsing of text with \x{...} characters.
What's New in TextPipe v7.0.5
=============================
* Fixed shell context items - the last item did not work. Also fixed the path
for the Split File filter.
* Fixed bug with Rolling back .BAK files - if the Only Output Modified Files
option was on, it would delete original files.
What's New in TextPipe v7.0.4
=============================
* Unicode conversion filter was only outputting the Byte Order Mark for the
first file.
What's New in TextPipe v7.0.3
=============================
* Added swap button to Unicode conversion filter.
* Fixed Unicode conversion filter bug.
What's New in TextPipe v7.0.2
=============================
* Fixed Backup Mode behaviour when the .bak file already existed (now it is
deleted).
What's New in TextPipe v7.0.1
=============================
* Fixed Hex Dump option for Edit Fields and File Grid.
What's New in TextPipe v7.0
===========================
* New Unicode (UTF-16LE) search and replace, with options for space compression
and for ignoring non-spacing characters.
* New Unicode (UTF-16LE) pattern matching.
* Unicode conversion filter is now much simpler, as you just choose an input
and output format in one step.
* New XSLT filter for manipulating XML.
* New file grid right-click menu items:
- Analyze file - checks for various Unicode, XML, CSV and Tab delimited
formats, Unix/PC/Mac end of line format and other file types
- Hex dump - displays a hex dump of the first 200 characters of the file
* Added \x{...} Unicode character matching for exact matches. This means that
for a Unicode space you can type \x00000020 instead of \x00\x00\x00\x20.
* Synchronized scrolling option for Trial Input and Output.
* You can now control if the Trial Input and/or Output are treated as Unicode.
* Optimized single byte maps for the special case of one output character for
every input character.
* Better help contexts for the 9 different search/replace types.
What's New in TextPipe v6.9
===========================
* Removed restriction on pattern recursion depth - this was causing Stack
Overflow errors for legitimate expressions.
* Fixed file grid ordering - if you moved rows around, TextPipe did not
remember the new row position.
* Fixed menu items for Remove, Copy and Move tab fields. These did not add the
required filters.
* Fixed help hyperlinks on Trial Run and Files tabs.
* Fixed bugs in Unicode Make Little/Big Endian filters.
* Fixed bug in Convert From Unicode filter, for when it encountered a character
that could not be converted. It now outputs a space.
* The EasyPattern [year] keyword now checks for a 4 digit year before checking
for a 2 digit year.
* Convert Word Document To Text filter now only closes the Active Document,
avoiding the MS Word error message 'This method or property is unavailable
because a document window is not active'.
* Fixed line wrapping problem with the clipboard export text of several
restrict-type filters.
* Increased maximum stack size to cope with increased size of Unicode filters
(and avoid Stack Overflows).
* Fixed database filter not quoting char or date/time data fields.
What's New in TextPipe v6.8.3
=============================
* New filters for handling pipe-delimited files:
Remove pipe fields
Restrict to pipe fields
Copy pipe fields
Move pipe fields
* Added EasyPattern keywords for slash, colon, hash, pound, percent, star,
asterisk and ampersand. EasyPatterns now generate much better perl regexps.
* EasyPatterns can now set the maximum expected match size - this allows them
to match text larger than the default of 4K.
* Increased processing speed for Trial Runs and Clipboard output.
* Restrict to fields filters now export the settings for Process Fields
Individually, Exclude Delimiter, Exclude Quotes.
* Fixed EasyPatterns [month] and [monthname] to attempt to match a long month
name (January, February) first, then a short month name (Jan, Feb).
* Fixed bug with Context Grep with lines after the match. Matching lines at the
end of the file were being omitted.
* Fixed code for handling CSV, Tab and Pipe delimited files with header lines.
What's New in TextPipe v6.8.2
=============================
* Added new EasyPatterns for [ CSVfield ] and [ TABfield ].
* New Restrict to Byte Range filter - useful for expanding mainframe packed and
zoned decimal fields.
* New Delete Byte Range filter.
* XML filter now has better matching of double and single quoted attributes.
These filters now handle embedded double single or double quotes, quotes
escaped with backslash, and embedded new lines.
* Optimized expand packed decimal and expand zoned decimal for speed.
* Fixed bug with swap UTF-16 and swap UTF-32 word order.
What's New in TextPipe v6.8.1
=============================
* Added Expand packed decimal and Expand zoned decimal filters.
* Fixed handling of Restrict to between tags filter - under some conditions the
trailing > of the start tag would be put in the replace result.
* Fixed Copy CSV/Tab fields bug. When copied fields were appended, the
delimiter was not inserted if the copy position was the next available field.
What's New in TextPipe v6.8
===========================
* Added Unicode functions
- Remove BOM (Byte Order Mark)
- Swap UTF-16 word order
- Swap UTF-32 word order
- Make Little Endian
- Make Big Endian
* Added 144 Unicode conversion functions to convert to and from:
ARMSCII-8 ASCII BIG5 BIG5HKSCS
C99 CES-BIG5 CES-GBK CNS-11643-1
CNS-11643-15 CNS-11643-2 CNS-11643-3 CNS-11643-4
CNS-11643-5 CNS-11643-6 CNS-11643-7 CNS-11643-INV
CP1046 CP1124 CP1125 CP1129
CP1133 CP1161 CP1162 CP1163
CP1250 CP1251 CP1252 CP1253
CP1254 CP1255 CP1256 CP1257
CP1258 CP437 CP737 CP775
CP850 CP852 CP853 CP855
CP856 CP857 CP858 CP860
CP861 CP862 CP863 CP864
CP865 CP866 CP869 CP874
CP922 CP932 CP949 CP950
DEC-Hanyu DEC-Kanji EUC-CN EUC-jisx0213
EUC-JP EUC-KR EUC-TW GB18030
GB2312 GBK GEORGIAN-ACADEMY GEORGIAN-PS
HP-ROMAN8 HZ ISO-2022-CN ISO-2022-CN-EXT
ISO-2022-JP ISO-2022-JP1 ISO-2022-JP2 ISO-2022-JP3
ISO-2022-KR ISO646-CN ISO-646-JP ISO-8859-1
ISO-8859-10 ISO-8859-13 ISO-8859-14 ISO-8859-15
ISO-8859-16 ISO-8859-2 ISO-8859-3 ISO-8859-4
ISO-8859-5 ISO-8859-6 ISO-8859-7 ISO-8859-8
ISO-8859-9 ISO-IR-165 JAVA JIS_X0201
JIS_X0208 JIS_X0212 JOHAB Johab-Hangul
KOI8-R KOI8-RU KOI8-T KOI8-U
KSC-5601 MacArabic MacCentralEurope MacCroatian
MacCyrillic MacGreek MacHebrew MacIceland
MacRoman MacRomania MacThai MacTurkish
MacUkraine MULELAO-1 NEXTSTEP RISCOS1
SHIFT-JISX0213 SJIS TCVN TDS565
TIS-620 UCS-2 UCS-2BE UCS-2-Internal
UCS-2LE UCS-2-Swapped UCS-4 UCS-4BE
UCS-4-Internal UCS-4LE UCS-4-Swapped UTF-16
UTF-16BE UTF-16LE UTF-32 UTF-32BE
UTF-32LE UTF-7 UTF-8 VISCII
* New context menu item to insert control characters like tabs and form feeds.
* New context menu item to show a hex dump of the selected text.
* Added logWarning to scripting model.
* Added Cut/Copy/Paste to file grid context menu.
* Added Tile function to Window menu.
* The Convert Word Documents To Text filter now disables Word's screen display
for faster processing.
* The TextPipe Engine DLL now has a COM interface identical to TextPipe's, but
removes most GUI operations for incredible speed.
* Added alert() function to the internal TextPipe object of the scripting
filter, so JScript functions can easily display debug dialogs.
* EasyPatterns bug fixes and improved flexibility. In particular, the [char]
keyword was fixed.
* Several filters that should have allowed subfilters did not. Filters affected
were: database filter, insert column filter, add left margin filter.
* Fixed bug - the filename was being output even for non-matching lines, when
context lines were included.
* Fixed bug with partial trial run menu items including too many items.
* Fixed bug with the filter tree allowing nodes to be pasted on the Input
Filter, resulting in error-producing subfilters of the Input filter.
What's New in TextPipe v6.7
===========================
* EasyPatterns - English-like text patterns for mere mortals e.g. to match
phone numbers, use
[3 digits, punctuation, 3 digits, punctuation, 4 digits]
As easy as that!
* Many fantastic new HTML and XML filters!
* Restrict a search/replace or other filters to an XML element, attribute or
to text between XML tag pairs
* Remove an XML element, attribute or XML tag pair.
* New Restrict To Filename filter. This allows you to search and replace inside
filenames, number and rename files and much more!
* Very powerful new debugging feature - selective trial runs. You can select
which filters are being tested without having to clone a piece of the filter.
You can perform a Trial Run on:
* Entire Filter List (current behaviour, default)
* Selected Filter Only
* Selected Filter and Sub-Filters
* Filter List up to and including Selected Filter
To see these new options, right-click on a filter in the tree view.
* New Backup Mode - renames original files to .BAK. Easily restore originals
with a single click in the Results window.
* New Convert Word documents to text files filter.
* Fixed bug when the Result window Cancel button was clicked twice in a row.
* Fixed bug with pasting filter tree items that were copied from level 2 or
deeper.
* Fixed bug with the Windows Explorer Extension that showed the TextPipe menu
multiple times.
* Fixed bug with multiple consecutive Script filters not passing header text.
* Fixed bug with Search/Replace Enable UTF-8 option and Extract option being
swapped when saved.
* Fixed loading of Unicode maps from .TAB and .CSV formats - blank fields were
erroneously skipped.
What's New in TextPipe v6.6.5
=============================
* Fixed bug with Remove Duplicates option of Sorting filter not being
respected.
What's New in TextPipe v6.6.4
=============================
* New macros @time, @date and @datetime.
* Fixed bug with handling of CSV fields with more than one line embedded in a
column.
What's New in TextPipe v6.6.3
=============================
* Vastly improved sorting performance for files larger than 50 MB.
* Simplified user interface by removing
1. Comments tab (old comments are now inserted into the filter list as the
first item)
2. Forcing the MDI child window to initially appear maximized, making it look
like a SDI application. The window size can still be changed as before
3. Removed the title that appeared above the properties
4. Removing the scratch pad tab unless a loaded filter has text in the
scratch area.
* Added UTF-32 Unicode Maps
* When Prompt On Replace is on, it can now be disabled during the search. Note
- this does not update the tree view immediately, and if the filter is
currently selected it has no effect.
* The evaluation version provides a warning if the user attempts to modify
Excel or Word documents.
* Unicode maps can now append multiple map files together into one map.
* Unicode maps can now log overlapping regions as warnings or errors.
* Improved Unicode map timings for populating with Default or blank values.
* Added multi-maps for mapping input Unicode to multiple output Unicode forms
depending on command line parameters.
* /MINIMIZED now examined before any other parameter, eliminating flicker.
* Fix error when the file grid was selected in the askSam version.
* Fix for Run Time version that prevented filter additions after a filter had
been loaded with /F=.
What's New in TextPipe v6.6.2
=============================
* New File Grid context menu option to copy 100 Kbytes to the Trial Run Area.
* Upgraded to PCRE 4.3 pattern matching library to fix assertions not working
correctly.
* Added warning message that not all filter types can be exported to the
command line.
* Tips and Wizard dialogs now allow filters being double clicked on from
Windows Explorer to be loaded.
* Tips and Wizard are only shown if a filter hasn't been automatically loaded.
* Run Time version now disables sound by default and does not show a tray icon.
* Filter overlay images are now updated correctly when a disabled sub filter is
deleted.
What's New in TextPipe v6.6.1
=============================
* Added Exit Codes depending on the highest level of error logged.
* New /EXPORTFILTERTOLOG command line option.
* Changes to support TextPipe Engine file processing.
* Trial Input now preserves Unix EOLs when a file is pasted or loaded.
* Changed menu structure to make it easier for new users. Removed some icons
from the toolbar.
* Fixed Access Violations with Remove Lines Matching Perl Pattern filter, and
on some random occasions, with Perl pattern matches.
* Fixed code generation of setPerl() statement.
* Fixed an extra blank line being inserted at the start of the next file after
a Unicode file was processed.
What's New in TextPipe v6.6
===========================
* New filter supporting search/replace lists. The lists can either be specified
in a grid, or they can be loaded dynamically from Excel, CSV or Tab-delimited
file formats at run-time.
* The file list now supports multiple file specifications separated by semi-
colons eg c:\INetPub\*.html;*.txt;*.htm
* The Split Files filter can now control how the output files are named.
* Subtract entries in the file list are now shown in red, and Ignore entries
(comments) shown in grey.
* The Script filter now uses a Syntax highlighting editor to display VBScript,
JScript, VBA, PerlScript and PythonScript code. It also allows separate
default scripts to be saved for each language.
* Unicode maps can now be loaded from and saved to Excel/CSV/Tab formats.
Unicode filters are now far faster and can deal with undefined characters -
such as removing them, replacing them with a custom string, sending them to a
VBScript sub filter for specialized processing, or allowing them to pass
through unchanged.
* The filter tree view now supports Cut, Copy and Paste clipboard operations.
There is also an undo action for the current filter. Filters can also be
pasted into any application as a text export.
* CSV and Tab-delimited files with CR/LFs embedded in fields are now handled
correctly. New restriction filters can be used to remove the embedded CR/LFs.
* CSV and Tab-delimited restricted filters can now remove the comma or tab
field delimiters and the surrounding quotes to make it easier for sub filters
to work with field data. Each field's data can now be processed individually
rather than as a concatenation of field data.
* Byte map lines where the output is different to the input are now shown in
yellow. Byte maps can now scroll directly to the character you press on the
keyboard - which makes finding mappings easier.
* In the audit log, merge file filters now summarize the changes made by
filters that follow them in the filter list. Split file filters also
summarize the changes made.
* GUI and internal changes to support the new French translation.
* New command line options /CLEARCOMMENTS, /CLEARFILTERS, /SAVEFILTER,
/LOGENABLE, /LOGMODE, /LOGTHRESHOLD, /PREPAREFILTERFORDISTRIBUTION,
/SAVEFILTER, /PLAYSOUND.
* When loading a list of commands from a command file with /Z=, comments can now be included in the file using a leading ';'.
* Speed improvements for the GUI and for filter execution.
* Audit logging now shows status for more filters including Scripts and Maps.
The audit log text shown for search/replace filters now matches what is shown
on the screen for ease of reference.
* Various COM scripting changes to support new features, and to allow DataPipe
to set the current directory.
* Perl patterns now support UTF-8.
* Convert end-of-lines filter now handles Mainframe CMS V- and F-format files
(downloaded to PC in EBCDIC format).
* Removed Rich Edit Memo controls - they caused RTF codes in plain text to be
interpreted as fonts, and incorrectly added extra CR/LFs to Add Margins-type
filters.
* The file list had a bug where it added file entries more than once if they
matched multiple file specifications in the same group.
* Fixed bug with loading of single byte maps where the map was not actually
loaded, from both the menu and from the map sub-form. Fixed Reverse function.
* Unicode Maps - fixed problem where changes to the grid were not detected and
saved.
* Fixed bug with importing Excel and Tab-delimited search/replace lists.
* Fixed bug with appending filters from the command line with multiple /F=
appearing in reverse order. Fixed filters such as /Hx not being added.
What's New in TextPipe v6.5.1
=============================
* New filters - CSV to Tab-delimited, CSV to XML, Tab-delimited to CSV, Tab-
delimited to XML.
* Fixed error message when egrep pattern matcher encountered a \000 (null).
Only perl patterns can handle nulls.
What's New in TextPipe v6.5
===========================
* Search and replace lists can be loaded easily using the Load List from
Excel/Tab/CSV formats in the Replace menu.
* The Task Bar Menu and Map Menu now display sub folders of the TaskMenu and
Maps folders, and sort all the filenames and folder names shown. This makes
it very easy to categorize these maps and filters into folders.
* If a filter has one or more of its sub filters disabled, a red slash is shown
through its icon in the tree view. This makes it easy to find filters where
disabled sub filters are hidden from view. A disabled filter still has a red
cross through its icon in the tree view.
* Custom patterns can now be defined in the file custom_patterns.txt in the
TextPipe.exe folder. The patterns can be added through the right-click menus
on every field.
* Sorting can now handle files of unlimited size. Previously sorting was
restricted to using physical and virtual memory.
* New sorting options for date and time, date, and time.
* New right-click option for filter tree view to turn a filter into a sub
filter.
* Matching/non-matching lines and other grep line based filters can now use
Perl patterns, egrep patterns, MS Word patterns and Brief patterns. The
addGrepFilter COM function has changed to support this.
* Export to VBScript/JScript/web page now also exports the search replace
options such as greedy matching, allow comments, buffer size etc. The edit
distance threshold parameter has been removed from the addReplaceFilter COM
function, and new functions added for setPerl, setEditDistance and
setBufferSize.
* Menus and tabs re-organisation, selection filters renamed to restriction
filters.
* A fixed width font is now used for most memo fields.
* Improved handling of malformed CSV files.
* Fixed export of Logging:Append to Log. The wrong value was being exported.
* Fixed generation of random files of specified size. All files were being
truncated at 8k.
What's New in TextPipe v6.4.1
=============================
* Added "Content Type" to system registry to help web downloads of .fll files.
* COM object now registers itself in the Running Object Table (ROT), and frees
itself at the correct times.
* New COM properties Application.visible and Application.activeFilter
* Fixed bug with moving nodes with sub filters.
* The Task Bar menu now correctly runs filters for the second and subsequent
runs - previously the status window stopped it from working.
What's New in TextPipe v6.4
===========================
* New filter to Remove a line range (in addition to the Head/Tail filter).
* New filter to Remove CSV fields.
* New filter to Remove Tab fields.
* New filter to Move CSV fields.
* New filter to Move Tab fields.
* New filter to Move Columns.
* New filter to Copy CSV fields.
* New filter to Copy Tab fields.
* New filter to Copy Columns.
* File/Open command can now open multiple filters at a time.
* Drastically improved the speed of 'head' filters and Remove All - they now
skip reading the remainder of the file no matter how large it is (a 'Head'
filter is used to extract the first N lines of a file).
* New option to display help in an embedded window that is synchronized with
the current action.
* Added filter export to VBScript and JScript - this can be used to very easily
create code for ASP or web pages or simple scripts.
* Added COM interface to create Head/Tail filter, Run External Program filter,
Split filter, Show/Remove Duplicates filter, Secondary Output filter. Logging
functions, Input filter and Output filter settings can now be controlled with
precision.
* COM functions are now error trapped to prevent dialog boxes appearing in
server versions. Error messages are captured to the ErrorText property.
* The Script Filter's default script can now be set.
* Fixed display issue where memo field containing multi-line text (such as the
search and replace fields) scrolled to the bottom rather than displaying text
from the top.
* The command line text of the External Program filter now does not have double
quotes removed from it.
* TextPipe now can paste more than 64K of text at a time into a memo control.
Previously controls could hold more than 64K of text, you just couldn't paste
that amount.
* TextPipe now forces text paste operations to be plain text.
* Speed improvements with string translation caching.
* Wizard form now aligns correctly.
What's New in TextPipe v6.3.6
=============================
* A new option to only output modified files was added to the Output filter.
* A new Search option on the File Menu allows filters to be easily located.
* The status window now shows how many bytes of the input file have been
processed.
* A quick short cut is now to double click on any of the filename fields to
simply open the file (e.g. Single file output).
* The Remove and Remove All buttons now work for all tabs (previously they were
not used for the Comments, Scratch Pad and Trial Run tabs).
* When filters are being run from the command line, a new blank filter window
is no longer created - this means that the status of the already running
filter can be easily seen.
* The Execute Program filter now deletes the Input and Output files when
processing has completed. This filter is commonly used for sorting very large
data files and other external processing.
* The context grep filters Remove matching/non-matching lines and Retain
matching/non-matching lines have been re-designed so that they work exactly
the same as the Select matching/non-matching lines filters.
* The /I command line option (recurse subfolders) now also applies to file
lists loaded using /L=.
* Added new command line option /CLEARFILES to clear the file list. Also added
/S0-/S6 to handle different search/replace types.
* Fixed bug with Remove/Retain Lines Matching Perl Pattern List, where all
backslashes needed to be doubled twice.
* Fixed bug with none of the /C... command line parameters working.
What's New in TextPipe v6.3.5
=============================
* Fixed problem with Extract Email Addresses filter removing one extra
character from the start of the email address when it started with mailto:
sendto:, email= etc.
* Improved window behaviour when TextPipe is activated from COM - the main
window is now not visible unless it is specifically shown.
* Improved COM handling - TextPipe exits correctly now that there are no
internal references to the Application object.
What's New in TextPipe v6.3.4
=============================
* Fixed problem with saving Count Duplicate Lines and Remove Duplicate Lines
filters.
What's New in TextPipe v6.3.3
=============================
* Fixed problem with Remove Patterns From List filter - was crashing.
What's New in TextPipe v6.3.2
=============================
* Fixed problem with multiple output filters overwriting the same file.
What's New in TextPipe v6.3.1
=============================
* Fixed sub filters not working for filters Add Text Side by Side, Add
Repeating Text Side by Side, Remove Lines Found In, Retain Lines Found In,
Remove Matching Lines Found In, Retain Matching Lines Found In.
* Added new options to the Export Command Line of the Output filter.
* Fixed problem with memos not displaying text properly.
What's New in TextPipe v6.3
===========================
* Added new Find in HTML helper window to help users Edit, Remove, Replace or
Append to text inside HTML tags (such as the ALT tag of IMAGES), between HTML
tags (such as between and ), and between two arbitrary pieces
of text.
* Added new 'Select each line in turn' filter. This is a short cut for creating
a 'Select matching lines' filter with a pattern of '^'.
* Window Menu now works properly - workaround found for Windows bug (being to
turn off AutoHotKeys and AutoLineReduction).
* New System menu item (on task bar) to force TextPipe to close, even if it has
been activated via COM or from DataPipe etc.
* Fixed double quotes appearing in filename fields after a filename has been
chosen.
* When special characters are pasted, the default mode has been changed from
decimal to hex (so where \018 would previously have been pasted for special
character 18, now \x12 would be pasted)
* New Word Wrap toggle item in the popup menu of memo fields.
* New Start Column and Length options for Sort filter, Remove Duplicates filter
and Count Duplicates filter.
* When a command line filter has been started with /G, TextPipe no longer
clears the filter list so that you can now see the contents of the command
line filter.
* New command line parameter /OUTPUTKEEPSTRUCT to control whether the input
file's folder structure is retained when a new output folder is set.
* Fixed a bug with dragging and dropping filters, where you could get an Access
Violation trying to edit the filter after moving it from inside its parent
filter.
* Fixed @inputFilename and @fullInputFilename incorrectly using the output
filename.
What's New in TextPipe v6.2.9
=============================
* Expanded the Special\Find and Replace menu item into an entire menu to make
it clearer.
* Now uses Windows standard dialog boxes for easier translation.
* Removed status window control resizing.
* Removed validation on perl patterns that prevented back references from
working.
* Fixed error with perl ^ not matching the start of the first line in files
less than 4K.
* Fixed error with Extract Filter - some non-matching text was being passed to
the output.
* Fixed the maximum allowed value on various filters - Split At Lines, Detail
lines allowed before writing to log file, size of random input file that can
be generated, insert column position, line numbering, context grep lines
before and after, delete columns values, duplicates filter, record length on
EOL filter, head/tail filter, all number-type filters like spaces to tabs,
centering etc, maximum buffer size for pattern matching etc.
* Fixed handling of single and double quotes inside database queries.
* Database filter 'insert script' option was not modifying file changed status.
* Fixed TextPipe.getGlobalVar - now returns a blank string if the variable has
not been defined, instead of the variable name preceded by '@'.
GlobalVariables are now case-insensitive, and can hold multi-line values.
* Fixed bug with 'Remove Prompting' not setting the modified flag if the filter
changed.
* Changed the text qualifier for database insert scripts from " to '
What's New in TextPipe v6.2.8
=============================
* All fonts are now set to the system default font. This makes translation of
Eastern languages far easier.
* Tools\Put Sample In Trial Input now only includes files that have the 'Add'
action enabled. It also handles the situation where no files have been
specified.
* Better DataPipe integration - now no longer hides the window when TextPipe is
closed. The main form minimizes instead.
What's New in TextPipe v6.2.7
=============================
* Improved Command Line Wizard dialog.
* New right click menu function for search/replace filters "Allow RTF tags"
converts the pattern to one that allows embedded RTF font tags.
* Better integration with DataPipe - COM functions have changed, now
Application.hide minimizes TextPipe, and Application.show restores it.
What's New in TextPipe v6.2.6
=============================
* Improved speed of COM functions.
* Added COM code to support DataPipe
* Fixed bug (again) where null lines caused the pattern matcher to fail.
What's New in TextPipe v6.2.5
=============================
* Race condition fixed where a command line processing thread started with /G
/Q doesn't get a chance to start before the application exits.
* New command line parameters /MAXIMIZED and /HIDDEN (hidden acts the same as
/MINIMIZED)
* COM functions execute() and executeClipboard() now don't return until the
processing thread has completed.
* New COM function isRunning to determine if a processing thread is still
running.
* The COM function addReplaceFilter()'s ignoreCase parameter has been renamed
to matchCase - now the sense of the value is correct, and is consistent with
the user interface.
* Fixed bug with perl-style patterns when used with look-behind assertions -
100 characters of text preceding the match is now retained in the search
buffer.
What's New in TextPipe v6.2.4
=============================
* Secondary Output Filters can now be disabled and deleted.
* Fixed errors occurring when a filter was modified after it had been moved up
or down using the up or down buttons.
* Added Application.Quit function to COM
* When created from COM, the default is now for the main form to be invisible.
What's New in TextPipe v6.2.3
=============================
* Secondary Output Filters can now be added throughout the filter list to
duplicate the output file, or write selected lines and columns out to a
separate file, eg to place error lines or records in an error file, or to
separate records of different type or length into new files.
* A new Select Block filter allows undelimited blocks of data to be selected
and processed as one.
* Fixed VB/Jscript timeout - value is in milliseconds, not seconds.
* Fixed obscure Perl replacement bug when run from command line.
* Validation of ActiveX scripts now only occurs for VBScript - JScript
validation didn't work because the MS JScript engine does not implement
various functions.
What's New in TextPipe v6.2.2
=============================
* Updated perl library to PCRE 3.7 (from 3.5)
* EOL filter now allows more than one character in the replacement string.
* Enabled some command line operations to provide Windows Explorer support in
TextPipe Web and Standard.
* Fixed problem with the About dialog (in the evaluation version) interfering
with filter loading when TextPipe was invoked by double-clicking or opening a
.fll file.
* Fixed bug with 'Escape Special Characters' not working properly.
* Fixed bug with Split After XX Lines filter only outputting one line.
* Fixed bug with 'Include Lines from End of File' when the number of lines was
greater than 255.
What's New in TextPipe v6.2.1
=============================
* Tree view now displays more than just the first line of scripts and comments.
* Fixed bug with perl-style grep and blank lines.
* Input Filter export showed incorrect value for Delete Input Files After
Processing.
* Filters loaded from the command line now have their full path saved, so they
get saved to the correct location even if the current directory is changed.
* Added missing properties to Filter Export function.
* Fixed bug handling command line filenames with embedded '..' paths.
What's New in TextPipe v6.2
===========================
Note: v6.2 was released quickly to correct some serious bugs, but it was not announced
until v6.2.1 was released with further bug fixes.
* New filter to Remove lines matching any patterns in a list.
* New filter to Retain lines matching any patterns in a list.
* New filters to Retain matching lines, Remove matching lines, Retain non-
matching lines and Remove non-matching lines - this is easier to understand
than the Select lines filters.
* New filter to add a file side-by-side with an existing file.
* New filter to add a file side-by-side with an existing file and repeat the
added file if the file being added to has more lines.
* New filter to Split a File after a given number of lines.
* New Input Filter to generate random a data file of a particular size.
* New filter to repeat a file's contents a specified number of times.
* Added Script Timeout option to VBScript/JScript filter
* Show Command Line dialog now also shows the current path and all environment
variables.
* Added 'Escape special characters' menu item to right-click menus of all
fields. This is very handy for adding backslashes in front of pattern
matching meta characters, and doubling '@' and '$' characters where
appropriate.
* Added 'Allow Extra Spaces' menu item to right-click menu of all pattern
fields, allowing you to easily search and replace in HTML files by ignoring
any extra spaces or tabs that commonly occur.
* Added 'Allow Extra Line Feeds or Spaces' menu item to right-click menu of all
pattern fields, allowing you to easily search and replace in HTML files by
ignoring any extra spaces, tabs or line feeds that commonly occur.
* Updated help, fixed application links to help file, help file now displays
when TextPipe is first run
* Fixed bug with filter loading
* Made splitter in Search/Replace filter visible, now resizes correctly.
* Fixed 'Add folder' button - newer versions of Windows caused this dialog to
appear behind the main window.
* Unknown field codes (a name preceded by an '@' symbol) are now NOT replaced
with a blank - they are left as is to prevent inadvertent use of a field code
causing text to disappear. Known field codes (@clipboard, @inputFilename,
@fullInputFilename) still work as normal.
* Added new COM function to filter windows - closeWithoutSave. Added new
options to COM interface, including default values.
* Fixed bug with a filter validation function not being called when there were
sub filters anywhere above them in the filter list.
* Fixed a bug affecting the Select Matching Lines, Select Non-matching Lines,
Select Lines From Length To END, Select Lines From Start To End, Select Lines
From Start For Length filters when immediately followed by a line-based
filter such as a Reverse Each Line, Pad To Width etc. Some text was not
output at all.
* Fixed a bug affecting the Remove Lines Found In List and Only Keep Lines
Found In List filters - because the list was not internally sorted, the
actual lines would only occasionally be processed correctly. A workaround was
to ensure that the line list is first sorted in ascending alphabetical order.
What's New in TextPipe v6.1.1
=============================
* Improved the email address extraction filter to automatically remove leading
'mailto:', 'mime:', 'smtp:', 'email=', and remove trailing '?Subject' and
trailing periods.
* Fixed Perl Pattern Match not saving 'greedy' setting
* Fixed hidden form problem with active field being invisible
* Fixed Access Violations on editing filter list
What's New in TextPipe v6.1
===========================
* PERL-STYLE pattern matching! - use both greedy and non-greedy matching
options, as well as embedded comments, assertions, non-capturing sub-
expressions and more!
* Brief-style pattern matching
* MS Word style pattern matching - use the *, ?, etc wildcards that you can use
in MS Word.
* New 'Extract' option for search and replaces, all non-matching text is
discarded.
* The Found Text can now be referred to in the Replacement Text as '$0' for
Exact, Sounds-like and Edit-distance matches. Previously the Found Text could
not be referred to, making some replacements harder.
* You can now easily add a sub filter to the selected filter by holding [Alt]
down while choosing it from the menu or selecting its speed button.
* You can now easily add a filter at the parent level of a sub filter by
holding [Shift] down while choosing it from the menu or selecting its speed
button.
* New Input Filter setting for text to come from the Trial Run Input area.
* The filters Add Left Margin, Add Right Margin, Add Header and Add Footer now
do not parse the included file for special functions or characters. This
ensures that the file being included is included exactly as is. The parsing
of text specified in the edit field continues as previously.
* Fixed a recursion bug when [Alt+Down] is pressed to move a filter and its sub
filters down, now the filters are moved down correctly.
* Fixed bug with base panel of search and replace filter disappearing after
returning from the Trial Run area.
* Removed the Font Control context menu item for controls.
* Better handling of Cancel button during a processing run.
* Fixed handling of NULL values with database filter and Generate Insert Script
mode.
* Database Command Timeout setting for queries that run for more than 30
seconds.
* Improved Tree handling is quicker and easier to use; the treeview changes
immediately when a setting is changed, and there is a new Up and Down button
to easily move filters up and down (in addition to Alt+Up and Alt+down).
* All command line defaults now come from the Normal Template normal.fll, not
the internal defaults which used to be:
inputFromFiles, promptOnEach=false, skip binary files,
binarySampleSize=100, outputToFiles, testMode=false, retainDateTime=false,
changeExtension=false, changeBaseDir=false.
* Fix for the error " The Decision Cube Capacity is Low. Please deactivate
dimensions or change the data set"
What's New in TextPipe v5.6.3
=============================
* Uninstall now removes all registry entries
* Installer now supports unattended installs
* Fixed short cut conflict between Remove/Remove All buttons and menu items
* Fixed bug with registry security in registered version
What's New in TextPipe v5.6.2
=============================
* Added 'Normal Template' functionality - a filter that is always loaded to set
defaults.
* Delete Input Files after Processing setting now displays a warning box when
it is enabled. When a new filter is created this setting always defaults to
disabled.
* Added shortcuts to tabs on status form, query replace form and command line
display form.
* Fixed error in COM documentation for AddFile function - constants should be
1,2 and 3, not 0, 1 and 2.
* Changed sizes of GUI controls to show foreign languages better.
* Fixed bug with loading of foreign language, and enabled support for radio
group type controls.
* Fixed bug with Append Mode.
What's New in TextPipe v5.6.1
=============================
* Clicking on the filename column in the file list now sorts the filenames.
* Improved COM interface - new methods for compiling the filter list which
improves speed if the same filter is used repeatedly
* New Append to existing file setting
What's New in TextPipe v5.6
===========================
* Localisation complete - now everything in TextPipe can be translated to a
foreign language by translating the file Languages\English.ini
For more details on how to translate TextPipe, please visit:
http://www.datamystic.com/textpipe/translate.html
* COM interface now allows TextPipe to be fully controlled from languages such
as VisualBasic, VBScript, C++, Delphi etc
For more details on how to translate TextPipe, please visit:
http://www.datamystic.com/textpipe/com_interface.html
* Fixed bug with dragging and dropping filters onto a filter that doesn't
support subfilters - now adds the dragged filter above it
What's New in TextPipe v5.5.2
=============================
* Added code for TextPipe Pro Run Time Engine
* Marketing changes for evaluation edition
* Began preparation for localisation
* Fixed command line processing bug with modifying the Output filter settings
after loading a filter with the /F= command
* Fixed bug with debug windows
What's New in TextPipe v5.5.1
=============================
* Forms and menus can now be translated into other languages via a .ini file in
the Languages folder
* Improved the load time of massive filter lists loaded via the /Z= command
line parameter
* Trial Output now shows Column and Row in the same way that Trial Input does
* File size for files larger than 2GB is now displayed correctly
* Improved the way that form sizes and positions are saved
* Improved the way that registered user data is saved under Win2K
* Forced installation to require the Administrator account to prevent registry
writing problems under Win2K
What's New in TextPipe v5.5
===========================
* Lines of context surrounding a matching line can now be displayed, both
before and after matching or non matching lines (grep filter)
* Added short cuts to tabs (Alt+1 through Alt+5)
* Added Filter Wizard to help new users
* Added command line options for setting the output file extension, output
folder, and merge output filename.
* Sub filters can now be created by holding down Shift as they are drag and
dropped to a location inside another filter
* The database filter now directly supports creating a database insert script
from extracted data
* Improved tutorial lessons
* TextPipe tutorial now listed in the start menu
* Fixed bug with default folder not being TextPipe's folder (default was My
Documents folder)
* Fixed bug with access violation on exit after a filter is invoked from the
command line
* Fixed bug with Count Duplicates filter missing some lines
* Fixed bug with Extract Emails filter missing the last email address if it
ended at the end of the file
* Fixed bug with errors not being reported during trial run - now if errors are
reported the status dialog will not automatically close
* Changed default extension to .fll for link filter dialog. Also added an open
button so that the filter can be easily loaded and edited
What's New in TextPipe v5.4.1
=============================
* Can now CHANGE THE REPLACEMENT TEXT during a run. This is very useful for
fixing up mistakes in the replacement text, and can also be used for pattern
matches
* New Paste Special command on context menus to allow pasting of special
characters without TextPipe converting them to its internal code
* Unknown '\' entries are now output with the leading '\' rather than without.
This is to help new users
* Trial Input and Output no longer attempt to validate special characters such
as \t etc.
* Fixed bug with '\' being incorrectly interpreted in the Prompt for replace
window
* Fixed bug with filters becoming modified when Search/Replace filter was
selected (not edited)
What's New in TextPipe v5.4
===========================
* VBScript/JScript code can now control TextPipe - LogError, LogInfo,
inputFilename, fullInputFilename, terminate, setGlobalVar, getGlobalVar,
subFilterEntireText, version
* VBScript/JScript code can now have subfilters. Subfilters can be turned on or
off by the script at any time using InitSubFilters, FlushSubFilters,
subFilterChunk
* Find/Find Again in all memo fields (multi-line edit)
* Font control dialog on all edit fields (including memos)
* Extended the number of filters than can be invoked via the command line
* Facility to generate TextPipe command line parameters from an existing filter
list
* Trial Run can now be interrupted - runs in separate thread
* Ctrl+A (Select All) now works in all fields
* More options in the Window menu
* Adhoc Transform tab renamed to Trial Run tab
* Task bar menu now sends TextPipe to the back after a menu item is selected
* Better handling of maximized windows when TextPipe restarts
* Fixed bug with Select lines filter - if the input had (say) 2 lines and the
setting was from line 3 to END
What's New in TextPipe v5.3.9 Beta
==================================
* Added drag and drop between filter windows
* Added drag and drop promotion/demotion and movement of filters in the filter
tree display (and removed the Up/Down buttons)
* Added Lesson 4 to tutorial
What's New in TextPipe v5.3.8
=============================
* "x2" function now duplicates sub filters at the same time
* Fixed bug with Insert Column At filter where the column was set to zero (ie
insert at end of line) and the actual line length = 1 (the text was inserted
at the beginning of the line)
* Fixed bug with replace filter and whole words option - output text can be
duplicated
* Fixed bug with merge filter and single file output filter
* Fixed bug with Close All function not closing all windows
* Fixed bug with Insert Filter File function changing the name of the currently
loaded filter
What's New in TextPipe v5.3.7
=============================
* Updated Export To Clipboard and Print facility to cope with new filters and
tree structured filters. This facility is an excellent way to maintain
version information about your filters
* Maps now moved to separate 'maps' folder
* textpipe.log is now created in the same folder as textpipe.exe if no path has
been specified
* Recent Files menu now uses submenu of main menu
* Filters opened will now load into the New Filter window if it is unchanged
and does not hold a filter
* Fixed problem with files and folders added via the command line not
defaulting the subfolders setting correctly
* Fixed problem with filter opening twice when opened from Explorer when
TextPipe isn't currently opened
* Fixed bug with merge filter not performing any filters following it in the
filter list
What's New in TextPipe v5.3.6
=============================
* Added ability for Windows Explorer to detect TextPipe and open a filter in an
existing TextPipe window
* Recycle bin functionality temporarily removed while bugs fixed
What's New in TextPipe v5.3.5
=============================
* Fixed buttons and help for Files Tab
* Delete file operations now use the Recycle Bin
* Fixed bug with Remove Lines From File and Only Show Lines From file filters
What's New in TextPipe v5.3.4
=============================
* (Hopefully) fixed long-standing error on exit
What's New in TextPipe v5.3.3
=============================
* New subscribe facility on help menu
* Fixed regexp bug with characters sets [] involving ranges of characters
specified with a \ eg [\000-\255]. Also error message for character sets
containing a \000.
What's New in TextPipe v5.3.2
=============================
* Better error handling when file delete/rename fails
* Fixed bug with number of subfolders to process (1 Level was same as None)
* File\Open now always opens a filter in a new window. New menu item to open in
the current window
* Fixed bug with Remove button, only removed first file from file list even if
multiple files were selected
* Now checks if log file exists before using Notepad to open it
* Double quoting of filenames and folders containing spaces now handled
correctly
* Better handling of dropped files
What's New in TextPipe v5.3.1
=============================
* Added option to delete input files once they are processed - to support
integration with GFI FAXmaker
What's New in TextPipe v5.3
===========================
* New Sorting options
* ASCII Sort (case-sensitive and case-insensitive). Previously only an ANSI
sort was available (where lower case letters sort before upper case letters)
* Numeric sort
* Sort by length of line
* New Unicode Map filter for translating Unicode files
* Improved online help with Quick Start guide, improved tutorial and more
cross-referencing
* Status form now has indicator to show whether test mode or overwrite mode is
active
* All memo fields now can save to and load from a file
* Trial output now has warning message if the output text contains null
characters
* Improved Command Line Assistant dialog
* Fixed bug with Query Replace window not scrolling found text into view
* Fixed bug with "First Match Only" option discarding text
* Fixed move filter up/down bug with filter lists containing more than 256
filters
* Fixed bug with database filter not extracting data correctly when fixed width
format with no column titles was performed
* Database filter now correctly handles non-SELECT queries that return a record
set
* Fixed bug with access violation on exit
* Fixed bug with pattern match ignoring First Match Only setting under some
circumstances
What's New in TextPipe v5.2
===========================
* Added help toolbar for easier access to helpful features
* Improved drag & drop behaviour for .fll files
* Added automation check to disable debug filters
* Added better error handling for MIME decode quoted printable filter
* Advanced logging details in results window
* Added error checking to ensure file can be deleted/moved to correct final
filename, or error logged if not
* Added output option for all files merged to a single file
* New Clear All and Paste context menu item
* Prompting dialog for Read Only files, Prompt Before Processing and Prompt on
Binary Files now has option for No To All and Yes To All
* New Search/Replace option to only replace the first occurrence
* Trial Input/Output now have horizontal scroll bars
* Grep filters (Keep matching lines, remove matching lines) now as select
filters, where matching lines get subfilters applied to them
* ActiveX scripting no longer requires dummy parameters for functions
* Improved match information tab for Edit Distance and Sounds-like matches
* Context menu on tree view for faster deletion/enable toggle
* Database query now creates correct XML document. Handling of previously
unrecognised data types. Original query output as comment. Headers always
output even if 0 rows returned. Unique column names generated for all output
types. Encoding="UTF-8" removed from XML header - not supported by some
versions of IE
* Status dialog now shows count of Non-binary Files Skipped
* New Edit Distance option for search/replace filters - very handy for finding
and locating misspelt words
* New option to retain the existing file list when opening a new filter
* New facility for search/replace to replace all or none within the current
selection
* Loading a .fll filter file now opens in the same window
* Better detection of filter list changed
* Better handling of loading very old filter lists
* Added force lines to width filter
* Added advanced logging facilities with detailed tracking of all changes made
* Fixed exception with exact match filter
* Fixed handling of non-select statements in Database filter, and improved
error checking code
* Fixed directory where preliminary output file created
* Fixed split filter - was not performing "start file" processing for following
filters
* Fixed Remove Email Headers - was crashing
* Fixed bug that affects all line-processing filters - when using Mac files the
first character on each line may be repeated
* Fixed bug with exact match filter that caused text to be output multiple
times
* Fixed Win NT bug with popup context menus on memo fields
* Fixed delete columns filter
* Fixed handling of grep/inverse grep filters
* Comment filters now have vertical scroll bars for comment text
* Fixed subfilter bugs where filter list was not built correctly, missing
several filters
* Fixed bug with Select Lines filter not outputting its results
* Fixed bug with Select CSV Fields filter
* Fixed errors with start and end word for Edit Distance and Sounds-like
filters
* Fixed split filter
* Fixed handling of Select Columns with the 4th option
* Fixed debug filter error
* Fixed Select CSV/Tab field missing last field
* Fixed handling of map menu and task bar menu
What's New in TextPipe v5.1
===========================
* ** Sub filters - drag and drop a filter onto another in the tree view and the
dropped filter will then process JUST the output from the parent node. Eg
drop a "Title Case" filter onto a "Search/Replace" filter to change the
search result to Title Case
* ** New Database Connection filter. Attach to any ADO/ODBC database and
execute any SQL command text against it. The result can be output as CSV,
Tab-delimited or XML (with automatically generated DTD schema). All
characters are appropriately escaped, including quotes within strings for
CSV, and XML special characters.
* Pattern matching now extended to handle up to 36 ($0-9,a-z) bracketed
expressions. This is 26 more than any other product on the market.
* New Select CSV Fields filter - select a group of consecutive CSV fields and
apply sub filters to the result by dragging and dropping them onto this
filter. Handles commas embedded in quotes etc
* New Select Tab-delimited Fields filter - select a group of consecutive tab-
delimited fields and apply sub filters to the result by dragging and dropping
them onto this filter
* New Select Line Range filter - select a group of consecutive lines and apply
sub filters to the result by dragging and dropping them onto this filter
* New Select Column Range filter - select a group of consecutive columns and
apply sub filters to the result by dragging and dropping them onto this
filter
* New Remove All filter - useful for subfilters
* Convert EOL filter can now specify any string as the new EOL character
* New Truncate to Width filter
* File output has new "Maintain folder structure" option when outputting to a
new folder
* Remove Columns filter now has more advanced options
* New option Skip Prompt if Identical for Search/replace filters
* ActiveX scripts can now easily output text at the start and end of each file
* New tools added - option to verify a filter before it is run - performs
syntax check etc. Also added Windows calculator
* Explorer extension - right click on files, folders or drives brings up
TextPipe options. New window on Tools menu to customise the Explorer
extensions
* Command Line Assistant window - provides examples of how to run TextPipe from
the command line in a variety of modes
* Show Command Line window - displays the command line parameters used to
invoke TextPipe - useful for debugging command line scripts
* Check for TextPipe Updates window - check if you have the most recent
TextPipe by querying the DataMystic web site
* TextPipe now interfaces to 2 external tools (see Help\Related Products menu)-
JustData from www.justsoft.com.au
Offline Explorer from www.metaproducts.com
GUI enhancements
* Tree view for filters which allows multi-level filters to be collapsed
* Multiple-document interface (MDI) allows multiple filters to be open at once.
New Window menu to support MDI interface
* Dockable toolbars
* Icons in menus
* Right-click (context) menus on all edit/memo fields allow special characters,
common patterns, replace expressions and macros to be inserted, as well as
the normal clipboard operations
* Can now set the font used in the Ad-hoc Input/Output area
Bug fixes
* ActiveX script now works in non-ad-hoc mode
* Trial Run area now does not interpret \n, \t etc
* Split files at Character - fixed bug
What's New in TextPipe v4.6
===========================
* Example code for the TextPipe Engine - a text transformation .dll that can be
downloaded from www.datamystic.com
* New ActiveX scripting filter supports arbitrary user-written code in
VBScript, Jscript or PerlScript, PythonScript, REXXscript etc
* Output To New Folder can now recreate multi-level folder trees and output to
a new drive
* New Undo command to undo any changes to the current filter
* New file grid button to Copy Row
* New Extract filter to extract just the required text
* Show Duplicates filter now called Count Duplicates, and outputs the number of
times found to the left of each item
* New Tools menu item to pull sample data from the file list or clipboard into
the trial run area
* New Tools menu item to move the Trial Run Output back to the Trial Run Input
* Add Line Numbers filter now allows format of line numbers can be changed to
custom user-defined settings, including numbering in hexadecimal etc
* Sort filter now has Ignore Case option
* Header, footer, left margin or right margin can now insert either a file or
text. Cursor position now shown
* Length of trial input and output area shown in both lines and characters.
Cursor position now shown
* Warning indicator on status bar now shows if Test Run mode is active or not
* Debug filter - creates a debug window showing the text passing through the
filter at that point
* External filter files can now be linked to, providing true 'black box' style
re-use, using File\Link To Filter
* Can now duplicate the current filter - this makes adding a large number of
similar filters very easy
* Find and replace filters now use multi-line edit control - making it easier
to edit large selections. The new edit control also provides the length and
line count of the text
* Maps now display a hex column in addition to the original Decimal and ASCII
columns
* Changed handling of changing the replacement text for a pattern-based search
- now the default text is not modified for future replaces
* Tips of the Day
* Query replace window now supports resizing better
* Changed registration URLs
* The filter names shown in the filter list are now truncated, preventing
Windows crashes with very long filter names
* Fixed logging functions which were going wild when more than 1000 files were
processed
* Fixed pattern matching not handling \n \r \e \t \a
* Fixed Randomize filter - was outputting blank text
* Fixed pattern based search with patterns longer than 247 characters - was
truncating and matching early
What's New in TextPipe v4.5
===========================
* Soundex search method to search for words that sound like another word.
Useful when you are replacing a typing error
* New Preferences dialog
- Play sound on completion
- If no association, use user defined editor (need new options window)
* Prepare filter for automation - removes all user prompting
* Prepare filter for distribution - removes all test text
* Can now insert a file with the Add Header, Add Footer, Add Left Margin and
Add Right Margin filters - browse button
* Add Line Numbers now has option to skip blank lines, (ie omit count but keep
counting), as well as omit count and not count line)
* Now can split files at a given character, after a specified number of
occurrences (and split before, after or on top of character)
* ANSI to Unicode and Unicode to ANSI filters (single byte to double byte)
* Comment filters now shown in italics, disabled filters shown with strike
through text, speed button to add comments
* Better progress indicator - now much more accurate
* Duration of filter job in seconds shown in status dialog
* Increased size of edit fields for easier editing of multi-line text. Display
of text length and number of lines of all memo fields (like Header, Footer,
Left/Right Margin, Insert Column etc)
* Performance improvement when handling very large files
* Improved performance for Remove Blanks from Start of Line, Convert to Lower
Case, Convert to Upper Case, OEM to ANSI, ANSI to OEM
* Query replace dialog now shows file currently being processed
* Query replace dialog now shows filter information for both normal and pattern
based searches (so it is easy to see which text was matched by each
expression)
* Improved command line automation support. Now can have comments embedded -
useful when converting Perl scripts to TextPipe scripts because code can be
commented out rather than edited out
* Form resizing now handled better
* Fixed bug with Query Replace when replacement text was modified before
replacing
* Fixed bug with saving/loading of window positions
* Fixed bug with detection of when the filter has been modified
* Fixed bug with query replace 'Yes - file' button - did not change the first
entry
What's New in TextPipe v4.4
===========================
* Name change from DropConvert to TextPipe
* Regular expression search and replace - allows pattern matching (also known
as non-exact matches or regexps). Case-insensitive or case-sensitive matching
* HTML Help integration
* Prompt on replace. Can change the replacement text
* Option to delete test files at end of test run
* @inputFilename macro now allowed in filters for Add Text To Start Of Lines,
Add Text At End Of Lines, Add Column Of Text
* New @clipboard macro to insert the clipboard contents
* Can disable filters by double-clicking or pressing Ctrl+T
* When either the error display or the file display is full it is sent to the
log file
* /z command line parameter to read parameters from a file
* Grep-based regular expression matching
* In-place editing of file specifications
* Inclusion and exclusion lists for file processing
* File groups allow better handling of complex file groupings
* Subfolder recursion can now be specified on a per-file basis. Improved
performance of subfolder recursion
* Improved detection for binary files - sample size can be adjusted, and binary
characteristics are better identified
* Case-sensitive replace - if found text is uppercase, replacement can be
forced to all uppercase etc
* New Export Filter to clipboard feature. Useful for documenting filters in
Word
* Enhanced detail when printing filters
* File associations for .dCv test files
* Status dialog now shows separate error tab, and shows files generated by each
filter, with the old and new size of each with a comparison display for quick
checks
* Install/uninstall feature. Creates Start Menu items, desktop icon, Send To
menu and file associations for .fll and .map files and for text files
* Scratch pad area for test text
* Trial run area for iterative testing
* Improved error log for command line initiation
* Pasted text is scanned for binary characters - and they are converted to
readable text. Pasted text is now checked to see if it has already been
converted
* Heaps of useful sample filters
* Window sizes now saved and restored. Minimum window sizes enforced
* File list now supports including and excluding files, file groups, subfolder
inclusion/exclusion on a per-line basis
* Scratch Pad area for saving chunks of text
* New Edit Menu with Cut, Copy, Paste and Disable/Enable Filter
* Settings now saved on a per-user basis
* Improved descriptions in filter window
* Improved performance. Better use of memory (now uses far less)
* Scrolling on drag of filters in filter list
* More filters and options available from command line
* Now handles filters from future versions better
* Printer setup menu item now doesn't get lost :-)
* Fixed bug with "Base map on filter list" function
What's New in TextPipe v4.3
===========================
* Filter to insert a column of text
* Filter to convert to ranDOm CasE
* Filter to extract URLs. Very useful for retrieving mailto, http, https, ftp
and gopher addresses
* Task bar menu. Allows filters to be loaded and run without leaving external
programs such as Word, enabling conversion to occur seamlessly without
leaving the currently running program
* All status windows from completed tasks are closed when starting a new task
* Input filter new options:
Input from file or clipboard
* Output filter new options:
Output to file or clipboard (independent of Input filter)
change file extension
change base directory on output
* Filter to only show duplicate lines
* Filter to reverse each line
* Filter to centre justify lines
* Filter to right justify lines
* Filter to remove lines contained in an external file
* Filter to only show lines contained in an external file
* Filter to run external program. Very useful for user-written filters or for
features not yet incorporated into DropConvert
* Filter to add comments to the filter list
* Character maths filter now shows hex and binary equivalents for operand
* File history (up to 5 filters) shown in file menu
* Tool bar buttons for commonly-used filters
* Floating hints now used in preference to status bar
* Explorer menus for .fll file type
* Removed evaluation edition restriction of 5 filters
* Now uses InstallShield install/uninstall
See http://www.datamystic.com for more details on TextPipe
Home
Buy Now
to download the full version upgrade
