Resources

Get Involved

Every contribution is welcome and needed to make AIKA better. If you would like to get involved, please contact me.

API Documentation

JavaDoc v2.0.2-alpha

Release Notes

v2.0.2-alpha (2022-03-11)

Preparation for the next major release.

• Rewrite of the algorithm to use binding-signals for the linking process.
• Training gradient computed from an objective function based on the entropy of the neuron and the information gain of the synapses.
• Replaced the hard coded math with a dynamic field concept that allows to arbitrarily propagate changes through pipeline like connections. The implementation of the math is now declarative instead of procedural.

AIKA Version 2.0.0-SNAPSHOT (2021-XX-XX)

Preparation for the next major release.

• Removed the node lattice from the algorithm
• Replaced the relations between synapses with the concept of pattern part neurons.
• Replaced the search for the optimal interpretations with branching of activations.

AIKA Version 1.4.0 (2019-08-16)

• Reduced memory consumption.
• Implementation to compute the average activation of an activation object over all interpretation options.
• Linking of interpretation options.

AIKA Version 1.3.0 (2019-07-31)

• Major simplification of the interpretation search.
• Code reorganization.

AIKA Version 1.2.0 (2019-06-07)

• Removed synapse bias. Bias now depends on the neuron type.
• Exception Handling refactoring.
• Removed factory methods.
• Refactored position propagation.
• Bugfixes

AIKA Version 1.1.0 (2019-02-28)

• Major cleanup refactoring
• Bugfixes

AIKA Version 1.0.0 (2018-12-09)

• Bugfixes

AIKA Version 0.25 (2018-12-02)

• Bugfixes

AIKA Version 0.24 (2018-11-17)

• Refactoring of the relation architecture.
• Bugfixes

AIKA Version 0.23 (2018-11-14)

• The Range class has now been replaced with by a slots concept. Previously, an activation had a range with a begin and an end position. Now activations can possess an arbitrary number of positions.
• The synapse bias is now used to decide whether a synapse is conjunctive or disjunctive.

AIKA Version 0.22 (2018-10-31)

• API Refactoring: Synapse relations are now established through a separate builder class.
• The range positions are now optionally variable. This feature is required for text generation. In this use case the positions are not known in advance and need to be computed during processing.
• Introduced passive neurons. Passive neurons are only evaluated if the connected output neuron requires it. Passive neurons act basically like callback functions.
• Optimization of the interpretation search.
• Lots of bug fixes.

AIKA Version 0.17 (2018-05-14)

• Introduction of synapse relations. Previously the relation between synapses was implicitly modeled through word positions (RIDs). Now it is possible to explicitly model relations like: The end position of input activation 1 equals to the begin position of input activation 2. Two types of relations are currently supported, range relations and instance relations. Range relations compare the input activation range of a given synapse with that of the linked synapse. Instance relations also compare the input activations of two synapses, but instead of the ranges the dependency relations of these activations are compared.
• Removed the norm term from the interpretation objective function.
• Introduced an optional distance function to synapses. It allows to model a weakening signal depending on the distance of the activation ranges.
• Example implementation of a context free grammar.
• Example implementation for co-reference resolution.
• Work on an syllable identification experiment based on the meta network implementation.

AIKA Version 0.15 (2018-03-16)

• Simplified interpretation handling by removing the InterpretationNode class and moving the remaining logic to the Activation class.
• Moved the activation linking and activation selection code to separate classes.
• Ongoing work on the training algorithms.

AIKA Version 0.14 (2018-02-04)

• Caching of partially computed states in the neural network during the interpretation search.
• Refactoring of the interpretation search. The search is now iterative to prevent stack overflows. The debugging output is much more detailed now.
• Ongoing work on the training algorithms.

AIKA Version 0.13 (2018-01-20)

• API cleanups: Input -> Synapse.Builder, Activation.Builder
• Optimization and simplification of the interpretation search.
• Refactoring of the range matching within synapses.
• Ongoing work on the training algorithms.

AIKA Version 0.12 (2017-12-12)

• Memory optimization: Disjunctive synapses are now stored on the input neuron side.
• The bias delta value in a neuron input is now an absolute value.
• Bug fixes, code cleanups, code readability improvements, lambda expression usage, convenience functions.

AIKA Version 0.11 (2017-11-26)

• Optimization for the search for the best interpretation.
• Optimization of the checkSelfReferencing function.
• Fixes for the training and pattern discovery functions.

AIKA Version 0.10 (2017-11-03)

• Simplification: Activations are now only added during processing never removed. However, they might be suppressed if they are conflicting with other activations.
• Removed some old experimental training code and provided two APIs for training and pattern discovery. The APIs allow to implement heuristics when deciding which synapses should be created or which patterns should be selected.
• Experimental support for text generation.

AIKA Version 0.9 (2017-10-22)

• Rewrite of the conversion of synapse weights to logic nodes.
• Optimization of the interpretation search.
• Fixes for a few deadlocks.

AIKA Version 0.8 (2017-09-17)

• Optimization of the interpretation search using an upper bound on the interpretation weights.
• Support for very large models with millions of neurons by suspending rarely used neurons to disk.

AIKA Version 0.7 (2017-08-06)

• Refactoring of the range model. Now the range begin and the range end can be treated independently of each other. Synapses now have three properties: range match, range output and range mapping.
• The Iteration class has been merged into the document class.
• Performance optimizations for the interpretation search in the SearchNode class.
• Test case fixes
• Class renaming: Option -> InterprNode, ExpandNode -> SearchNode
• Lots of javadoc

AIKA Version 0.6 (2017-07-01)

• Mainly optimizations

AIKA Version 0.5 (2017-06-01)

• Simplification of the algorithm!
• Lots of optimizations!
• New unified model for weights and neuron activation values.
• Options are now generated for all neuron activations.
• Disjunctions of options are now supported.

AIKA Version 0.2 (2016-07-09)

• Annotation of text ranges instead of individual characters.
• Use of the relational id for pattern matching instead of character positions.
• Use of a lattice to represent text ranges.
• Allow a single neuron to suppress multiple inputs.
• Lots of optimizations!

AIKA Version 0.1 (2016-02-27)

• Implementation of a symmetric lattice structure to represent the different interpretations that arise from the usage of non-monotonic logic.
• Implementation of an algorithm to determine the interpretation with the highest associated weight sum. This algorithm efficiently searches for non-conflicting combinations of options by limiting the search space with an upper bound.

Related Resources

Jumble : A Job Search Engine whose tagging is powered by AIKA.
KDnuggests : A list of Text Analysis, Text Mining and Information Retrieval software.

Acknowledgments and Support

YourKit supports open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of YourKit Java Profiler and YourKit .NET Profiler, innovative and intelligent tools for profiling Java and .NET applications.

Developers

Lukas Molzberger

Contact

Lukas Molzberger
53111 Bonn

lukas[dot]molzberger[at]aika[dot]network