Question about stopword list and word stemming (german)

thomas_wiedmann

This is my first try to use Stopword Filter (german) and word stemming (german). I try to understand whats going on. I put some (german) Text inside. Result Input und Output looks nearly like the same. So I get some questions:

输入:

Dies ist ein Text mit einigen Worten und einem Punkt. Gestern bin ich gegangen, morgen werde ich gehen.

Output:

dies ist ein text mit einigen worten und einem punkt. gestern bin ich gegangen, morgen werde ich gehen.

a) Is there a list of which words are filtered by the stopword filter operator?

b) What is Stem (German) do?

Process

<宏/ >

谢谢!

Thomas

Telcontar120

I believe you need to use these operators inside a larger "process documents" operator where you perform tokenizing first, so they have some discrete word tokens to operate on. Currently these operators are not doing anything because they are trying to operate on the entire document text at once, which is not possible for either stemming or stopword removal.

Thomas_Ott

@Telcontar120beat me to it! Here's a sample process@thomas_wiedmann

<宏/ >

thomas_wiedmann

Ok, I try this one...

Result:

tex wor punk gegang

Uuuh. True, but first have to meditate about this result... ;-)

I had very much to learn...

谢谢!

Thomas