|
Member 10415611 wrote: Amongst other things, I want to identify the stock & figure out if the remarks were +ve, neutral or -ve (i.e. their "sentiment").
If the remarks are made by a human, you'll need a human to interpret it. A computer will not recognize sarcasm, hypotetical hypno hypothetical situations, or personal biases. You could just as well count all the times the word "buy" appears.
Also, does the algorithm "know" if the article says "updated: 1900h, confirmed hoax"?
Member 10415611 wrote: on a reserved set of another 150 sentences
Yes, but humans will generate unexpected sentences with weird opinions, and words that are "just invented" and "cool".
Member 10415611 wrote: "The Stocks Are Doing Well" are still rated as neutral
Which in my head is neutral, as it is merely a statement about the current situation. In itself, the statement cannot be said to be positive nor negative, even from a traders' perspective.
It would be great if you could expand the sentences to train toward todays headlines. The more variations the AI sees, the better it becomes. In theory at least, I'm not giving any guarantees.
Bastard Programmer from Hell 
If you can't read my code, try converting it here[^]
|
|
|
|
|
Eddy,
Thanks for your comments. What you say is definitely true regarding sarcasm, hypothetical situations, biases, etc. Similarly, there are many unexpected sentences, weird opinions and invented words. My data set is from about 10 different speakers with sentences randomly selected from the segments where they are specifically discussing a particular stock. Even though this is a fairly narrow domain it's amazing how many ways people come up with of saying the same thing. Also, they very seldom say "buy", "sell" or "hold" even if directly asked for their recommendation. They will usually say about 5 or 6 sentences which I, as a human, can interpret as a veiled buy/sell/hold recommendation. I am not sure if training using a more general source would help. The original "model" provided with the Stanford NLP API is based on film reviews & it gave only about 52% accuracy on my original training set. It's training data contains a lot more general phrases as well as film related ones. I might try combining my set & theirs for an experimental training run & see if that helps. Ultimately, however, I think that what's needed is another "layer" of intelligence that actually puts things together to "understand" the sentences rather than just applying a kind of matrix of +ve/-ve scores for words and phrases in the sentence. The "sentiment" analysis is only a part of my code, another part is "rule based" from looking at keywords and the structure of questions/answers. I hope by combining these two things that I can get a bit further.
|
|
|
|
|
Member 10415611 wrote: They will usually say about 5 or 6 sentences which I, as a human, can interpret as a veiled buy/sell/hold recommendation.
That's your basic human, not willing to commit to anything and giving vague descriptions instead of a simple "42" with complete specs.
Member 10415611 wrote: I think that what's needed is another "layer" of intelligence that actually puts things together to "understand" the sentences
"Understanding" would be a holy grail like achievement.
Perhaps you don't need complete understanding of the language - if you can identify the sentiment more correctly than simple statistics can, then you'd have an advantage over those who can not. And perhaps it would be helpful to combine those ideas, since even sarcasm follows a pattern* that humans must be able to recognize.
*) in a single language the syntax should be predictable
Bastard Programmer from Hell
If you can't read my code, try converting it here[^]
|
|
|
|
|
in a single language the syntax should be predictable
the syntax in a single language should be predictable
the syntax should be predictable in a single language
predictable the syntax in a single language should be
predictable in a single language the syntax should be
predictable in a single language should be the syntax
predictable in a single language should the syntax be
I'm sure there are more, but now I'm bored.
|
|
|
|
|
AI can't understand elephant.
|
|
|
|
|
..and a good example too.
Bastard Programmer from Hell 
If you can't read my code, try converting it here[^]
|
|
|
|
|
Are you using backprop or RNT?
I wanna be a eunuchs developer! Pass me a bread knife!
|
|
|
|
|
Mark,
The Stanford system uses a "Recursive Neural Tensor Network" to train its sentiment model. The sentences are first parsed and processed into a set of "binary trees" with sentiment scores (0, 1, 2 for -ve, neutral & +ve in my case) attached to each word and phrase. I'm afraid I'm not an expert in the theory of NLP so not sure how that fits into "backprop or RNT." I've learnt a bit about the overall field of NLP & a fair bit about the Stanford approach with the hope of creating my application without making some dumb error but that's as far as it goes.
|
|
|
|
|
Hmm. If they want predictions, they should go with backpropagation, rather than RNT(N). RNT isn't quite as "intelligent" (which, partly, means that you can understand its decisions, because it's more instance-tree population, ergo a percentage player, than a genuinely "intelligent" solution).
Backprop seems ideally suited to the problem you're working on, but I suppose it's not someone's "pet concept" at the moment. That's universities, for you.
I wanna be a eunuchs developer! Pass me a bread knife!
|
|
|
|
|
Interesting. I'll have to look into backprop.
|
|
|
|
|
A friend of mine is a computational linguist. He says that at best it's gotten to about 85%, but that's with well structured source. What surprises me is that even with highly specific data, getting it better gets very complicated (though even in the highly specific stuff he recently worked on, 50% accuracy saves so much time that even that level of accuracy is worth it.)
|
|
|
|
|
Joe,
Interesting. What do you mean when you say:
Joe Woodbury wrote: 50% accuracy saves so much time that even that level of accuracy is worth it.)
|
|
|
|
|
If you're using natural language processing to assist in some task which is completed by humans, getting 50% completely right could save those humans a tremendous amount of time. Further, getting 85% accuracy with, say, even a 10% error rate may actually cause the humans to take even more time than if they hadn't used the computer program in the first place.
|
|
|
|
|
It's pretty hard to convince the general public that AI's making any sort of headway considering how easy it still is for something that should be as simple as Windows Update to completely mess up their computer.
(I realize this is apples and oranges...but you go ahead and explain it to those not in the field...)
|
|
|
|
|
If your salt and pepper wish you a Merry Christmas, is that seasons greetings?
Bad command or file name. Bad, bad command! Sit! Stay! Staaaay...
|
|
|
|
|
No, it's "seasonings greets"!
- I would love to change the world, but they won’t give me the source code.
|
|
|
|
|
It's: seasons' greetings. (punctuation)
Sin tack ear lol
Pressing the any key may be continuate
|
|
|
|
|
The expected sage advice: during this chili season, it thyme to curry favor with your condiments.*
*Condom-Mints are, perhaps, a popular seasonal snack, but I won't mention it, asI was tempted to extend he pun but didn't.
| Ravings en masse^ |
|---|
| "The difference between genius and stupidity is that genius has its limits." - Albert Einstein | | "If you are searching for perfection in others, then you seek disappointment. If you are seek perfection in yourself, then you will find failure." - Balboos HaGadol Mar 2010 |
|
|
|
|
|
If they are talking to you, you have had way too much of Nagy's favorite.
... such stuff as dreams are made on
|
|
|
|
|
I might have to Mrs. Dash out of here on that one.
|
|
|
|
|
St. Valentines Day is the season to curry flavour with parsley, sage, rosemary, and thyme.
Especially in Scarborough.
If you have an important point to make, don't try to be subtle or clever. Use a pile driver. Hit the point once. Then come back and hit it again. Then hit it a third time - a tremendous whack.
--Winston Churchill
|
|
|
|
|
I've just had a support call from a customer to make some changes to a bespoke customer management and invoicing system, that I interfaced to their accounting system. I gave my normal one year of free support after delivery and acceptance, and offered continued support after that for a fee. This they declined, as the company "was undergoing a management and ownership change".
I never heard from them again.
Until today, that is.
I just hope I can remember what the hell I was writing TWELVE YEARS AGO! 
Apparently, "It just worked". 
|
|
|
|
|
Chris C-B wrote: Apparently, "It just worked".
Or they've finally started using it
|
|
|
|
|
Actually, that was the first thing I asked - "What? Have you just started using it then?".
Apparently, it was been in continued use throughout.
I should have charged them more. 
|
|
|
|
|
Chris C-B wrote: I should have charged them more.
You can, this time! 
Bad command or file name. Bad, bad command! Sit! Stay! Staaaay...
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
