Skip to content

About

A multiThreading local search engine built using C++ & TF_IDF Algorithm

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

A Local Search Engine in C++

A multiThreading local search engine built using C++ & TF-IDF Algorithm

Quick Start

$ make && ./se

Usage: se COMMAND <Args...>
Commands:
  index  <input_file> <output_file> Index the input file and save to the output file.
  search <index_file>               Perform a search using an indexed file.

Dependencies

  • C++17 standard library
  • libxml2: XML toolkit implemented in C, used to parse & write xml files
  • Snowball: Used to stem tokens

Preformance

On my machine using Intel i5-8250U (8) @ 3.400GHz, I tested the application using more than 4000 document from CppReferences files, and the results are:

  • Indexing:

    $ time ./se index documents documents.out.xml
    real 0m3.311s
    user 0m12.814s
    sys  0m1.644s
  • Searching:

    $ ./se search documents.out.xml
    
    > add element to a vector
    2882 result found in 32ms
    ...

About

A multiThreading local search engine built using C++ & TF_IDF Algorithm

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Contributors

Languages