Aug 30, 2021 Replies: 14 NLP (Natural Language Processing) is a complex task. In the past it was only accessible to data scientists and linguistics experts, however with the rising popularity of machine learning it is now accessible to all developers, with enough time and energy. This is still not a simple process and it does require understanding the main concepts of NLP and preferably machine learning. The OpenNLP library wraps Apache open source OpenNLP project: https://opennlp.apache.org/ The library includes the APIs to load models and use the various features. The training, when needed, should be done with the command line methods. They are quite convenient to use. The currently exposed features are: Language detection Sentence detector Tokenzier Names / entities recognition Document categorizer Part of speech tagger Lemmatizer Stemmer Chunker How to get started? - The ApacheOpenNLP documentation is a must: https://opennlp.apache.org/docs/1.9.3/manual/opennlp.html - Download the complete package: https://github.com/AnywhereSoftware/B4J-OpenNLP (zip) - Copy OpenNLP.b4xlib and opennlp-tools-1.9.3.jar to the additional libraries folder. - Run the OpenNLP Example project. It depends on Java 11+. Download link is available here: https://www.b4x.com/b4j.html Tutorials Movie reviews sentiment analysis: https://www.b4x.com/android/forum/threads/nlp-sentiment-analysis.133922/ Last edited: Sep 1, 2021 Click to expand...
NLP (Natural Language Processing) is a complex task. In the past it was only accessible to data scientists and linguistics experts, however with the rising popularity of machine learning it is now accessible to all developers, with enough time and energy. This is still not a simple process and it does require understanding the main concepts of NLP and preferably machine learning. The OpenNLP library wraps Apache open source OpenNLP project: https://opennlp.apache.org/ The library includes the APIs to load models and use the various features. The training, when needed, should be done with the command line methods. They are quite convenient to use. The currently exposed features are: Language detection Sentence detector Tokenzier Names / entities recognition Document categorizer Part of speech tagger Lemmatizer Stemmer Chunker How to get started? - The ApacheOpenNLP documentation is a must: https://opennlp.apache.org/docs/1.9.3/manual/opennlp.html - Download the complete package: https://github.com/AnywhereSoftware/B4J-OpenNLP (zip) - Copy OpenNLP.b4xlib and opennlp-tools-1.9.3.jar to the additional libraries folder. - Run the OpenNLP Example project. It depends on Java 11+. Download link is available here: https://www.b4x.com/b4j.html Tutorials Movie reviews sentiment analysis: https://www.b4x.com/android/forum/threads/nlp-sentiment-analysis.133922/
H Hamied Abou Hulaikah Well-Known Member Licensed User Longtime User Aug 30, 2021 #3 Please fix, Where is shared files? error result: The system cannot find the file specified. B4X: #CustomBuildAction: folders ready, %WINDIR%\System32\Robocopy.exe,"..\..\Shared Files" "..\Files"
Please fix, Where is shared files? error result: The system cannot find the file specified. B4X: #CustomBuildAction: folders ready, %WINDIR%\System32\Robocopy.exe,"..\..\Shared Files" "..\Files"
Erel B4X founder Staff member Licensed User Longtime User Aug 30, 2021 #4 Hanz said: This is only for b4j? Click to expand... Yes. HAH said: Please fix, Where is shared files? error result: The system cannot find the file specified. Click to expand... Fixed. Just remove this line.
Hanz said: This is only for b4j? Click to expand... Yes. HAH said: Please fix, Where is shared files? error result: The system cannot find the file specified. Click to expand... Fixed. Just remove this line.
H Hanz Active Member Aug 30, 2021 #5 This is like the grammarly... But, for business applications, like accounting system, I am wondering if it has relevance. But it's very interesting, I hope it can be used with b4a, FB's messengers translate messages from non-english sentences into english.
This is like the grammarly... But, for business applications, like accounting system, I am wondering if it has relevance. But it's very interesting, I hope it can be used with b4a, FB's messengers translate messages from non-english sentences into english.
H Hamied Abou Hulaikah Well-Known Member Licensed User Longtime User Aug 30, 2021 #6 Example compilation error .. B4X: Compiling generated Java code. Error B4J line: 63 End Sub javac 1.8.0_121 src\b4j\example\opennlp.java:916: error: local variable target is accessed from within inner class; needs to be declared final jo.setObject(target); ^ 1 error
Example compilation error .. B4X: Compiling generated Java code. Error B4J line: 63 End Sub javac 1.8.0_121 src\b4j\example\opennlp.java:916: error: local variable target is accessed from within inner class; needs to be declared final jo.setObject(target); ^ 1 error
Erel B4X founder Staff member Licensed User Longtime User Aug 30, 2021 #8 Hanz said: FB's messengers translate messages from non-english sentences into english. Click to expand... You will need to use a web service for translation. Building a translation engine requires huge efforts.
Hanz said: FB's messengers translate messages from non-english sentences into english. Click to expand... You will need to use a web service for translation. Building a translation engine requires huge efforts.
J John Naylor Active Member Licensed User Longtime User Aug 30, 2021 #9 This is amazing! Perfectly timed too. My middle daughter is studying linguistics at university and was asking if I had any access to NLP as she has some ideas she'd like to explore as part of her course delving in to forensics and language use. This maybe paves the way to a nice little project together. Awesome work @Erel thank you.
This is amazing! Perfectly timed too. My middle daughter is studying linguistics at university and was asking if I had any access to NLP as she has some ideas she'd like to explore as part of her course delving in to forensics and language use. This maybe paves the way to a nice little project together. Awesome work @Erel thank you.
Roberto P. Well-Known Member Licensed User Longtime User Sep 23, 2021 #10 HI, very interesting, do you think it can also be used to automate a content management system (KB \ LMS) for technical content?
HI, very interesting, do you think it can also be used to automate a content management system (KB \ LMS) for technical content?
Erel B4X founder Staff member Licensed User Longtime User Sep 23, 2021 #11 Roberto P. said: do you think it can also be used to automate a content management system (KB \ LMS) for technical content? Click to expand... I need more information... What exactly are you trying to automate?
Roberto P. said: do you think it can also be used to automate a content management system (KB \ LMS) for technical content? Click to expand... I need more information... What exactly are you trying to automate?
fredo Well-Known Member Licensed User Longtime User Sep 23, 2021 #12 Roberto P. said: ...for technical content... Click to expand... This would be also a good idea for search support for laymen in extensive collections of special knowledge. An example would be an App searching medical texts for possible causes based on symptoms. Searchers are guided to helpful information based on non-professional inputs that help them find the underlying cause. This will not be able to replace professional medical support. But it can avoid unnecessary medication, for example, if you find out that your regular headaches are related to excessive sugar consumption or that you need proper vision care.
Roberto P. said: ...for technical content... Click to expand... This would be also a good idea for search support for laymen in extensive collections of special knowledge. An example would be an App searching medical texts for possible causes based on symptoms. Searchers are guided to helpful information based on non-professional inputs that help them find the underlying cause. This will not be able to replace professional medical support. But it can avoid unnecessary medication, for example, if you find out that your regular headaches are related to excessive sugar consumption or that you need proper vision care.
Roberto P. Well-Known Member Licensed User Longtime User Sep 23, 2021 #13 Erel said: I need more information... What exactly are you trying to automate? Click to expand... the search for technical answers in a db. For example procedures and user manuals or FAQs
Erel said: I need more information... What exactly are you trying to automate? Click to expand... the search for technical answers in a db. For example procedures and user manuals or FAQs
fredo Well-Known Member Licensed User Longtime User Sep 23, 2021 #14 Roberto P. said: ...search for technical answers... Click to expand... This seems to be an interesting field on which there is a lot of serious writing: https://www.google.com/search?q="OpenNLP+"+technical+texts But as it seems, the analysis of technical texts is a challenge in its very own way: https://www.sciencedirect.com/science/article/pii/S2213846320301668
Roberto P. said: ...search for technical answers... Click to expand... This seems to be an interesting field on which there is a lot of serious writing: https://www.google.com/search?q="OpenNLP+"+technical+texts But as it seems, the analysis of technical texts is a challenge in its very own way: https://www.sciencedirect.com/science/article/pii/S2213846320301668
Erel B4X founder Staff member Licensed User Longtime User Sep 23, 2021 #15 NLP, by itself, is less suitable for information retrieval / search engines tasks. It can help the search engine by adding more information to the text, but if you want to build a search engine then it is best to use a search engine such as Elastic Search. I did create an example with Elastic Search: https://www.b4x.com/android/forum/t...arch-search-and-text-analytics.73335/#content It is probably outdated for now.
NLP, by itself, is less suitable for information retrieval / search engines tasks. It can help the search engine by adding more information to the text, but if you want to build a search engine then it is best to use a search engine such as Elastic Search. I did create an example with Elastic Search: https://www.b4x.com/android/forum/t...arch-search-and-text-analytics.73335/#content It is probably outdated for now.
