李大仁博客

CaCl2#

Other language versions: Simplified Chinese, English

I. Introduction to CaCl2#

CaCl2 (CaCl2: Chinese Lexicon) English name: CA Chinese Language Lexicon, derived from a domestic financial industry NLP project. By analyzing existing corpora, it obtains a vast amount of entry data while cataloging and classifying entries according to financial industry standards. In the natural language processing (NLP) process, it can be used for word segmentation, keyword extraction, content summarization, entity recognition, and other purposes. The goal of the CaCl2 project is to provide the internet with an industry-specific, complete, and accurate lexicon, completing the foundational work of Chinese language NLP, allowing users to devote more energy to business research. CaCl2 is an important component of the open project CaOCl (CA Open Chinese Lexical Analysis Toolkit).

Statistics#

1. Number of Entries#

2. Number of Industry Dictionaries#

For detailed statistical status, please refer to the link: CaCl2 Open Status Statistics

II. Quick Start#

1. Clone or Download CaCl2 Lexicon as Needed#

Clone

git clone https://github.com/limccn/cacl2.git

Download

wget https://github.com/limccn/cacl2/blob/master/archive/v0.2/\[dictionary code].zip

2. Import and Configure the Lexicon#

The publicly available CaCl2 lexicon supports use in various word segmentation tools and environments.

Usage Example#

import jieba
dict_name = '480000.txt'
jieba.load_userdict(os.path.join(BASE_PATH_TO_DICT), dict_name))

Usage Example#

<properties>
<entry key="ext_dict">480000.txt;480100.txt;</entry>
</properties>

3. Test and Start Using CaCl2, Enjoy!#

III. Lexicon Open Source Progress#

1. Open Sourced#

2. Planned Open Source#

3. Technical Preview#

Before the public release of the dictionaries, we provide a technical preview of 10,000 entries from each of the 28 primary industries. For the actual number of entries contained in the dictionaries, please refer to the link: CaCl2 Open Status Statistics

**For original format entries, please refer to: /dicts For detailed open status, please refer to the link: CaCl2 Open Status Statistics

IV. Usage Effects#

1. Tool Testing Comparison#

1.1 Comparison of Word Segmentation Results Using CaCl2 Standard Lexicon and Jieba Standard Library (@CaoWJ)#

1.2 Word Segmentation Comparison Using CaCl2 and Financial Industry Lexicon [Zhaojin Ciku] (@CaoWJ)#

1.3 Word Segmentation and Summary Using CaCl2 and Financial Industry Lexicon [Zhaojin Ciku] (@CaoWJ)#

2. Metrics and Scores#

2.1 Industry Dataset Testing#

2.1.1 Financial Industry (Banking Industry), Word Segmentation Test#

2.1.2 Financial Industry (Financial Industry, Excluding Banking), Word Segmentation Test#

2.2 Standard Dataset Testing#

V. History and Change Log#

1. Regular Release Versions#

2. Automatic Release Versions#

For historical automatic release versions, please refer to the link: Version History

VI. License#

1. Open Source Software License#

The source code of CaCl2 is open-sourced under the Apache License 2.0.

    Copyright 2021 limc.cn All rights reserved.
    
    Licensed under the Apache License, Version 2.0 (the "License");
    you may not use this file except in compliance with the License.
    You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

    Unless required by applicable law or agreed to in writing, software
    distributed under the License is distributed on an "AS IS" BASIS,
    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    See the License for the specific language governing permissions and
    limitations under the License.

2. Co-Creation License#

The open lexicon, corpora, models, and other materials of CaCl2 are licensed under the Creative Commons BY-NC-SA 4.0 license.

VII. Contributions and Contributors#

Thanks to all contributors of CaCl2 for their efforts. We welcome all contributors who wish to participate and contribute to the CaCl2 project.

1. How to Contribute?#

1.1 Fork or Star our CaCl2#

1.2 Participate in CaCl2 community discussions on GitHub#

2. Contributors#

@CaoWJ

VIII. Frequently Asked Questions#

IX. Other Notes#

Some content of CaCl2 comes from publicly available information and data on the internet. CaCl2 does not guarantee the completeness and accuracy of the data and does not constitute any advice. We do not hold any securities mentioned in this article and have no affiliation with the companies mentioned in this article.

X. References#

1. Shenwan Guotai Junan Research Institute Industry Classification Standards. 2014