Help-Site Computer Manuals
Software
Hardware
Programming
Networking
  Algorithms & Data Structures   Programming Languages   Revision Control
  Protocols
  Cameras   Computers   Displays   Keyboards & Mice   Motherboards   Networking   Printers & Scanners   Storage
  Windows   Linux & Unix   Mac

Plucene::Analysis::CJKAnalyzer
Analyzer for CJK texts

Plucene::Analysis::CJKAnalyzer - Analyzer for CJK texts


NAME

Plucene::Analysis::CJKAnalyzer - Analyzer for CJK texts


SYNOPSIS


        # isa Plucene::Analysis::Analyzer

        my Plucene::Analysis::CJKAnalyzer $wt 

                = Plucene::Analysis::CJKAnalyzer->new(@args);

                

=head1 DESCRIPTION

This is a text analyzer for analyzing CJK texts. Plucene does not support CJK texts natively. This module encodes terms in the MIME::Base64 manpage format to get around this problem. Texts are assumbed to be in UTF-8 encoding.

See t/cjk.t for more details.


METHODS

tokenstream


        my Plucene::Analysis::CJKAnalyzer Plucene::Analysis::ChineseAnalyzer->new(@args);

Creates a TokenStream which tokenizes all the text in the provided Reader.


SEE ALSO

Plucene

the MIME::Base64 manpage

the Plucene::Analysis::CJKTokenizer manpage


COPYRIGHT

Copyright (C) 2006 by Yung-chung Lin (a.k.a. xern) <xern@cpan.org>




This library is free software; you can redistribute it and/or modify it

under the same terms as Perl itself



=cut

1;

Programminig
Wy
Wy
yW
Wy
Programming
Wy
Wy
Wy
Wy