首页 / NEO4J / Solution for automatic update of Chinese word segmentation full-text index in NEO4J

Solution for automatic update of Chinese word segmentation full-text index in NEO4J

内容导读

互联网集市收集整理的这篇技术教程文章主要介绍了Solution for automatic update of Chinese word segmentation full-text index in NEO4J，小编现在分享给大家，供广大互联网技能从业者学习和参考。文章包含7253字，纯文字阅读大概需要11分钟。

内容图文

Solution for automatic update of Chinese word segmentation full-text index in NEO4J

Failed to implement automatic updates using the NEO4J INDEX API, converting a way of thinking to solve this problem (synchronizing updates to the corresponding full-text index when updating a node or creating a new one.)

1. Sample data

Sample Data Format Reference
技术分享图片

2. Differences between English and Chinese Full-Text Indexes

1. Create NEO4J default index

                    CALL apoc.index.addAllNodes(‘Loc‘, {Loc:["description","cause","year"]})
                    // The following retrieval was unsuccessful:
                    CALL apoc.index.search(‘Loc‘,‘Loc.description:Chinese~‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘Loc.description:Chinese*‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘Loc.description:test~‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘Loc.description:Test Chinese~‘) YIELD node RETURN node

2. Delete Index

                    CALL apoc.index.remove(‘Loc‘)

3. Create an index that supports Chinese words

                    CALL zdr.index.addChineseFulltextIndex(‘Loc‘,["description","cause","year"],‘Loc‘) YIELD message RETURN message

                    // The following retrieval was successful:
                    CALL apoc.index.search(‘Loc‘,‘description:Chinese~‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘description:Chinese*‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘description:test~‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘description:Test Chinese~‘) YIELD node RETURN node

3. APOC has its own English full-text indexing process (indexing can be updated automatically)

1. Add Full-Text Index

                    CALL apoc.index.addAllNodes(‘Loc‘, {Loc:["description","cause","year"]},{autoUpdate:true})

2. New Nodes and Attributes

                    CREATE
                    (n:Loc {name:‘V‘})SET n.description=‘Testing Chinese word segmentation, the final chapter of the duplicate show was very exciting. It is said that knowledge mapping and artificial intelligence technology were applied to that movie!‘,n.cause=‘Test the English word breaker, Mobile World Congress, the world‘s largest gathering for the mobile industry, ‘RETURN n

3. Retrieval

Indexes can be updated automatically, but they are not friendly to Chinese retrieval, such as the following tests:

                    // Retrieval failed:
                    CALL apoc.index.search(‘Loc‘,‘Loc.cause:Test English word breakers~‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘Loc.description:Test Chinese word segmentation~‘) YIELD node RETURN node

                    // Retrieved successfully:
                    CALL apoc.index.search(‘Loc‘,‘Loc.cause:Test English word breakers*‘) YIELD node RETURN node
CALL apoc.index.search(‘Loc‘,‘Loc.description:Test Chinese word segmentation*‘) YIELD node RETURN node

4. Custom Chinese word segmentation full-text index plug-in (unsuccessful automatic index update)

The addChineseFulltextAutoIndex process succeeds in creating a full-text index to add a full-text indexing process that supports Chinese, but automatic updates are not supported for updating new attributes of nodes.

1. Add Full-Text Index

                    CALL zdr.index.addChineseFulltextAutoIndex(‘IKAnalyzer‘,["description","cause","year"],‘Loc‘,{autoUpdate:‘true‘}) YIELD message RETURN message

2. New Nodes and Attributes

                    CREATE
                    (n:Loc {name:‘V‘})SET n.description=‘Testing Chinese word segmentation, the final chapter of the duplicate show was very exciting. It is said that knowledge mapping and artificial intelligence technology were applied to that movie!‘,n.cause=‘Test the English word breaker, Mobile World Congress, the world‘s largest gathering for the mobile industry, ‘RETURN n

3. Retrieval

After adding a full-text search, you can retrieve:

                    CALL zdr.index.chineseFulltextIndexSearch(‘IKAnalyzer‘,‘description:Acridyl Aminomethane Sulfonymethoxyaniline‘,100) YIELD node RETURN node

Re-index before retrieving:

                    CALL zdr.index.chineseFulltextIndexSearch(‘IKAnalyzer‘,‘description:test~‘,100) YIELD node RETURN node

V. Label Cross-search

Add ChineseFulltextAutoIndex/addChineseFulltextIndex supports multiple tags while retrieving, using the same index name when building the index.
Tag: Loc

                    CALL zdr.index.addChineseFulltextAutoIndex(‘Loc‘,["description","cause","name"],‘Loc‘,{autoUpdate:‘true‘}) YIELD message RETURN message

Tag: LocProvince‘

                    CALL zdr.index.addChineseFulltextAutoIndex(‘Loc‘,["description","cause","name"],‘LocProvince‘,{autoUpdate:‘true‘}) YIELD message RETURN message

Retrieve node:

                    CALL apoc.index.search(‘Loc‘,‘name:p~‘) YIELD node RETURN node

技术分享图片

6. Custom Chinese Word Segmentation Plugin (Failed to Update Indexes Independently of Nodes)

To support single-node index updates, develop the following process.(The automatic update scheme described in the third section fails, and updates to the corresponding full-text index synchronously when updating or creating a new node.)

1. Add Full-Text Index

                    CALL apoc.index.remove(‘Loc‘)CALL zdr.index.addChineseFulltextIndex(‘Loc‘,["description","cause","year"],‘Loc‘) YIELD message RETURN message

2. Add Nodes and Attributes and Update Full-Text Index

                    CREATE
                    (n:Loc {name:‘V‘})SET n.description=‘Testing Chinese word segmentation, the final chapter of the duplicate show was very exciting. It is said that knowledge mapping and artificial intelligence technology were applied to that movie!‘,n.cause=‘Test the English word breaker, Mobile World Congress, the world‘s largest gathering for the mobile industry, ‘RETURN n

3. Add 2 new nodes or updated attributes to the index

                    MATCH
                    (n)WHERE n.name=‘V‘WITH n CALL zdr.index.addNodeChineseFulltextIndex(n,[‘description‘])RETURN*

4. Retrieval

                    CALL zdr.index.chineseFulltextIndexSearch(‘Loc‘,‘description:Test Chinese~‘) YIELD node RETURN node

技术分享图片

7. Resolve Transaction Submission Timeout

If the transaction commit timeout setting is configured, Cancel when building the index.

#********************************************************************
### Neo4j transcation timeout
###******************************************************************
#dbms.transaction.timeout=180s

Use a background script to execute the indexer:

                    # index.sh
                    #!/usr/bin/env bash
                    nohup /neo4j-community-3.4.9/bin/neo4j-shell -file build.cql >>indexGraph.log 2>&1 &
                    // build.cql
                    CALL zdr.index.addChineseFulltextIndex(‘IKAnalyzer‘,[‘description‘,‘fullname‘,‘name‘,‘lnkurl‘],‘LinkedinID‘) YIELD message RETURN message;

All of the above references to the NEO4J custom process

原文地址：https://programmer.ink/think/5cd0160be03d2.html

原文：https://www.cnblogs.com/jpfss/p/11603140.html

内容总结

以上是互联网集市为您收集整理的Solution for automatic update of Chinese word segmentation full-text index in NEO4J全部内容，希望文章能够帮你解决Solution for automatic update of Chinese word segmentation full-text index in NEO4J所遇到的程序开发问题。 如果觉得互联网集市技术教程内容还不错，欢迎将互联网集市网站推荐给程序员好友。

内容备注

版权声明：本文内容由互联网用户自发贡献，该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容， 请发送邮件至 gblab@vip.qq.com 举报，一经查实，本站将立刻删除。

内容手机端

扫描二维码推送至手机访问。

本文链接：https://qyyshop.com/info/1122639.html

来源：【匿名】