Questions tagged [natural-language-processing]
Natural language processing draws knowledge from a diverse collection of fields including computer science, linguistics, and statistics in order to extract pertinent information from the spoken or written word.
42 questions
-2
votes
3
answers
208
views
Its possible to distinguish between functional and non functional software requirements by computer software? [closed]
I am trying to do a computer program that can distinguish the functional and non-functional requirements written in Arabic languages from the Linguistic structure, so I am I look for the things that ...
- 19
-1
votes
1
answer
59
views
Equal transformations on both indexed content and query content before a search is attempted
In search engine indexing, a body of text is often processed before it is indexed. A common example is stemming, were words are reduced to their root form (plurals are dropped, tense is normalized). ...
- 171
4
votes
2
answers
647
views
Database structure for word co-occurrence frequencies in a large corpus
I would like to store the frequencies with which words co-occur with each other over a variety of contexts in a large (> 1 billion tokens) text corpus. I need to store the word pair, the type of co-...
- 51
3
votes
1
answer
94
views
What approaches can I take to figure out the "relevancy" of certain terms in a string?
I'm not even sure "relevancy" is the most accurate word, so I'll just describe the problem:
I'm building an app that needs to somehow parse product descriptions from a popular website (let's just say ...
- 323
0
votes
1
answer
530
views
What is the best way to summarize a sentiment value for a paragraph of text based on the sentiment value for the sentences within it?
So I am using Stanford CoreNLP in my project. I have data which consists of reviews of products on a forum. I need to be able to assign a sentiment value to a given review. CoreNLP allows you to ...
- 121
3
votes
2
answers
689
views
How to build a class for comparing words in a lexical dictionary?
I'm wanting to create a class that stores words in a set so that I can see if a word belongs to that set or not. I'm not wanting to build ever set every time I instantiate the class, so I'm using what ...
- 591
0
votes
1
answer
197
views
Which strategy to use in Client-Server messaging to trigger specific behavior in them?
I'm developing a virtual assistant to manage transactions in a business. I'm using an external service to handle Natural Language and
get intents, actions and parameters from my user requests.
The ...
- 103
1
vote
1
answer
751
views
What type of "spam filter" algorithm will tokenize characters for non-exact matches?
I was having a look at a basic example of spam filtering using a logistic regression algorithm and an answer posted on this Stack Overflow question: https://stackoverflow.com/questions/29291263/mllib-...
- 205
17
votes
2
answers
729
views
How to find hard to misspell given names?
Here is a question that I believe could be solved with some data mining and a sophisticated algorithm, but I don't quite know how. Any pointers as to what data sources to use and what algorithm to ...
- 281
-2
votes
1
answer
392
views
Using NLP can we create a summary of functional specification [closed]
Just thinking that is it somehow possible by using Language processing APIs to extract a must have points or an intelligent summary from documents like functional specifications ..
- 143
8
votes
2
answers
1k
views
How do personal assistants typically generate sentences?
This is sort of a follow up to this question about NLG research directions in the linguistics field.
How do personal assistant tools such as Siri, Google Now, or Cortana perform Natural Language ...
- 2,787
4
votes
1
answer
178
views
How can I test a search engine for an uncommon human language?
We are writing a search engine from scratch in a quite uncommon language, Aramaic, mostly for learning purposes but also because few resources are available in given language.
The engine is/will be ...
- 141
0
votes
1
answer
443
views
Natural Language to Search Criteria - Date Ranges
Consider an application that stores a set of records that contain:
Description
Cost
Purchase Date
I'd like to be able to allow users to utilize natural language to search the dataset.
For example, ...
- 142
0
votes
1
answer
1k
views
What is the purpose of chunking strings in natural language processing?
I see many examples of libraries that use a 'chunker' and also people asking how to write chunkers, but what is this for and why do we need it? Isn't it enough to split a text by whitespace or other ...
- 267
1
vote
1
answer
239
views
How to do simple natural language categorization [closed]
How would you go about parsing a sentence like
"Bought two kilos of steak from Acme supermarket" into a data structure like the following JSON representation:
{
item: {name: "steak", tags: "meat,...
- 121
3
votes
1
answer
263
views
Tasks incorrectly categorized with online text classifiers
Context: Finding company to do the job
The use case of an application I want to write is that a user will describe a task to be performed by some company, e.g.,
I want to move 10 boxes (30x40x50cm) ...
12
votes
2
answers
2k
views
Persisting natural language processing parsed data
I've recently started experimenting with natural language processing (NLP) using Stanford's CoreNLP, and I'm wondering what are some of the standard ways to store NLP parsed data for something like a ...
user25791
1
vote
2
answers
3k
views
How to create a Semantic Network like wordnet based on Wikipedia?
I am an undergraduate student and I have to create a Semantic Network based on Wikipedia. This Semantic Network would be similar to Wordnet(except for it is based on Wikipedia and is concerned with "...
3
votes
2
answers
695
views
Available options for classifying words in text?
I am researching ways to classify words in text and I'm wondering what options there are and which are best suited to this job. I'm mostly interested in keywords which are most often nouns.
So far I ...
- 1,213
1
vote
1
answer
3k
views
Is Agile Development used in Machine Learning and Natural Language Processing?
I've been developing web apps for a while now and it is standard practice in our team to use agile development techniques and principles to implement the software.
Recently, I've also become involved ...
- 1,320
11
votes
6
answers
3k
views
How to teach a script to detect sarcasm? [closed]
I'm currently building a fun script, that basically matches given phrases and gives a predefined response based on the match-points. You can ask it to retrieve some information based on live feeds, ...
- 793