# <img src="media/logo.png" width="40" style="vertical-align:middle;"> AntWordProfiler

Laurence Anthony, Ph.D.  
Faculty of Science and Engineering,  
Waseda University  
3-4-1 Okubo, Shinjuku-ku, Tokyo 169-8555, Japan

**VERSION HISTORY**

2.3.0

This is a minor upgrade with new features, improvements, and bug fixes.

New Features

-  Added an automatic update checker that notifies users when a new version is available.

-  Added a new in-app help system using markdown-based documentation with a table of contents, images, and platform-specific instructions.

-  Added new BNC/COCA 1.3.0 reference word lists with 35 levels.

-  Added Linux Flatpak packaging support for easier installation on Linux.

-  Added a build and distribution pipeline with automated version manifests, release notes generation, and PDF documentation creation.

Improvements

-  Refactored settings management to use a new serialization-based system, replacing the old INI-based configuration.

-  Improved the coverage statistics aggregation logic.

-  Reorganized reference word lists into versioned subdirectories.

-  Improved file loading with better progress reporting and a dedicated loading thread.

-  Improved the writable path handling for user data files.

Bug Fixes

-  Fixed various issues with file profiling and stats updates.

-  Fixed widget copy/paste behavior in list and table views.

-  Fixed PDF text extraction to work more reliably.

2.2.1

This is a minor upgrade with a few important bug fixes.

Bug Fixes

-  Fixed a bug causing settings with non-ASCII characters to not be loaded correctly.

-  Fixed a bug causing font settings to not be saved or loaded correctly.

2.2.0

This is a minor upgrade with new features and bug fixes.

New Features

-  Updated the software to work with QT5, making it easier to build the app for Linux.

-  Revised the coverage viewer display to make the coverage values easier to see.

Bug Fixes

-  Fixed a few issues when processing user files vs the inline text editor that sometimes caused the stats page to not update correctly.

-  Fixed a problem that causes the radiobuttons in the global settings to not act independently.

2.1.0

This is a minor upgrade with new features and improvements.

New Features

-  The backend database has been completely rewritten to allow for much faster processing of target files.

-  The latest version of Qt (the graphical engine) and the main user interface has been redesigned to hopefully look better on macOS.

-  AntWordProfiler can now run as a native app on both macOS-Intel and macOS-Silicon.

2.0.1

This is a minor upgrade with several bug fixes.

Bug Fixes

-  In the previous version, clicking "Start" in the "File Profiler" tool would cause all the information for all files in the "Statistics" tab to be updated before showing the profile for the selected text. This could slow the performance so now the "Statistics" page will not be updated. To update the "Statistics" tab, you will need to click the "Start" button in that tab.

-  In the previous version, clicking "Start" in the "File Profiler" tool would cause a temporary file to be created and displayed if the file profiler was not showing the contents of a currently selected file. Now, if no file contents is being shown and the "Start" button is clicked when a file is selected, the contents of that file will be shown.

-  Progress during the "File Profiler" updating is now shown in steps.

-  The PDF to text converter engine has been updated and some settings have been changed to allow it to deal with a wider variety of PDF oddities.

2.0.0

This is a major upgrade with the application completely re-written in Python.

New Features

-  AntWordProfiler has now been completely re-written in Python, allowing for a much-improved user experience. All existing functionality has been ported to the new version except for thesaurus-based file simplification. If this feature is desired by users, I will consider adding it to a future release.

-  The build process to compile the app for Windows has been updated. Now the application is released with an installer or as a portable application. The app is also digitally signed by Microsoft so fewer security errors will appear.

-  The build process to compile the app for macOS has been updated. Now the application is released as a dmg file that can be installed into a normal location (e.g., the Applications folder). The app is also digitally signed and notarized by Apple so no security errors will appear.

-  The Linux build has also been updated. Now the app can be run by clicking on the AntWordProfiler.sh file in the main folder.

1.5.1

This is a minor upgrade with one bug fix.

Bug Fixes

-  Fixed a bug that caused the help file to not be shown correctly in the help menu.

-  Help file updated.

1.5.0

This is a minor upgrade to update the icon and allow the app to run more smoothly on Big Sur.

New Features

-  Icon updated.

-  The left and right panes of the file view profiling tool can now be resized. This is necessary for Mac.

-  The help file is now split into help, license, and version history and each file is now accessible independently in the help menu.

-  The various help files are now updated to reflect new changes.

1.4.1

This is a minor upgrade with one bug fix.

Bug Fixes

-  Due to changes introduced to the graphics rendering on Macintosh OS X 10.9 (Mavericks), AntWordProfiler did not refresh correctly after certain actions making the screen look to freeze. The earlier workaround was click outside of the AntWordProfiler window and back into the window to force a refresh. This new version of AntWordProfiler fixes the problem at the code level and so no refresh issues should be seen in the future. The workaround has involved creating a standard build of the Perl programming language based on Citrus Perl (5.16.0) and the latest Tcl graphics engine. The introduction of the latest versions of these tools may introduce other very small changes in results due to the use of the latest Unicode standard, but these are unlikely to affect normal users.

1.4.0

This is a major update that adds new features and bug fixes.

New Features

-  Sorting of results can now be made at two independent levels chosen by the user from the choices of (frequency, range, or word).

-  Users can now opt to use their own token definition instead of the default one.

-  The help menu option now launches this PDF file instead of a basic text file.

-  Warnings are now issued before closing the file viewer window.

Changes

-  Some of the widgets in the interface have been renamed to make their actions easier to understand.

-  The ordering of global settings categories is now alphabetical.

-  Highlight colors have now been adjusted to be more pleasant on the eye.

-  The regular expression associated with the default token definition is now shown.

-  The thesaurus option is now turned OFF by default.

-  This readme file is now formatted as a PDF file.

Bug Fixes

-  The Stop button has been removed from the main window because it never 'stopped' the program properly before. To force close the program, just click on the button at the top of the window.

-  The progress bar in the main window now updates properly during a long operation.

1.3.1

This is a minor update addressing one small bug and adding new features.

New Features

-  Added an option in the thesaurus settings menu to allow users to select to automatically update the file view after editing it with the thesaurus tool.

-  Massively improved (>10 times) the speed of the file viewer tool when highlighting texts.

Bug Fixes

-  Corrected a bug that caused the local frequency count in the file viewer to report values for characters as well as words.

-  Tidied the interface a little so large frequency values do not become hidden in the file viewer tool.

-  Fixed a bug that caused the program to hang if the Profiler Tool start button was clicked when no files or lists were imported.

1.3.0

This is a major update adding new features and correcting various bugs in the 1.2x versions.

New Features

-  Revised the names and cleaned contents of the internal baseword lists (approved by Paul Nation).

-  Added an option to view a complete frequency list of the target files in the profile.

-  Added an option to view words not in the target files in the profile.

-  Added new sort options (word, range, freq).

-  Added a batch process option (main window only).

-  Revised this readme file.

-  Added a new thesaurus viewer (activated via a menu option).

-  Revised the profile output to include cumulative frequencies.

-  Improved the User File Viewer tool to display all level lists in a scrolled pane.

-  Added new editing functions (Previous, Next) to the User File Viewer tool.

-  Added a new edit function to simplify the target text via a level-marked thesaurus.

Bug Fixes

-  Corrected an unintuitive feature that duplicated the listing of internal baseword lists after importing a settings file.

-  Corrected a bug that caused the windows to not be centered when first displayed.

-  Corrected a bug that prevented more than eight baseword lists to function correctly.

1.2.1

This is a minor update to correct a few bugs and minor issues in the 1.2.0 version.

New Features

-  Added a new icon to the software.

Bug Fixes

-  Fixed an issue that caused the global settings options to not appear on Macintosh OS X.

-  The icon for AntWordProfiler has been updated to a graphic that matches other AntLab tools.

-  The height of widgets has now been fixed to make them fluid and thus allow them to take their full height on each operating system.

1.2.0

This version includes many changes and so deserves its 1.2 status.

New Features

-  Redesigned the software engine so that the program now works smoothly with Unicode (UTF-8) encoded files. This means the program will work with any language (including Asian languages) provided that the target files and baseword lists are saved in the UTF-8 encoding.

-  Redesigned the settings files to be easier to edit and work with (for creating user generated settings files). The settings file is no longer an XML file. Rather, it is a special file with a very simple format.

-  The main window title now shows if the program is using a user-settings file or not.

-  Any errors do not show appear on the main window anymore. This makes debugging a little more difficult, but improves the user experience.

1.1.4

Bug Fixes

-  Fixed code to correctly update the level list word database when analyzing new texts. Previous versions would produce strange results if the User File view was used without generating a main set of results first.

1.1.3

New Features

-  Recoded to allow Macintosh OS X version to be compiled easily.

1.1.2

Bug Fixes

-  Deleted two file menu options that were redundant (Choose Main Word List, Choose User Word List).

-  Added widget names to interface that were included in the settings file but not reflected.

-  Repositioned widgets to allow non-English names to be used successfully.

-  Revised the internal level lists to exactly match those in Paul Nation's original Range program (not Range BNC). The previous versions of AntWordProfiler used the first three Range BNC lists. Note that either set of lists can be imported and used as is. Note also that the placement of some entries in the Range lists is questionable (see Bug fix 1 in version 1.1.1).

1.1.1

Bug Fixes

-  Corrected the placement of "M" in the Nation Baseword List 1. Originally this had its own entry, but now it is correctly placed as a family member of "BE".

-  Corrected the trimming of non-token characters from the beginning of file lines. These caused the not-in-list results to include a stray entry count.

-  Updated and redefined the settings of the compiler for AntWordProfiler. This may resolve the problems reported by some users in Asia who cannot launch the program.

-  Added XML header to user settings file.

1.1.0

This is a major update with new features and bug fixes.

New Features

-  Introduced a database back engine, allowing much larger files to be processed.

-  Hugely improved the speed of processing. Now, 7 million words can be processed in around 1 minute.

-  Introduced a tag ignore feature allowing tagged files to be processed without change.

-  Greatly simplified the program (and interface) by adopting Paul Nation's Range format for level list files.

-  Importing and exporting of the settings is now possible via an XML file.

-  Simplified the save format options. The Excel save format may be reintroduced later.

-  Changed the name of the program to more accurately represent what it does.

-  Re-wrote this readme file to reflect the new changes.

Bug Fixes

-  Several mistakes in the language of the interface have been corrected.

-  Error reports that occur when pressing Cancel in some dialog boxes have been fixed.

1.0.1

Bug Fixes

-  Corrected how to read in main word lists and level lists so that blank lines and lines starting with non-token characters are ignored. In version 1.0.0, blank lines would generate very strange results.

-  Added character encodings for Chinese, Taiwanese, and Korean (Japanese encodings were already included in version 1.0.0).

1.0.0

This is the first version of the program.