JSON: options

[githubmanticore]

Implement OPTIONS support in the JSON interface. Some users are suffering from the lack of that.

I suggest we split this task into 2:

• prepare specification of how it will look
• implement it

[sanikolaev]

Another related issue is manticoresoftware/manticoresearch-python#7
Looks like we'll need to prioritize it.

[githubmanticore]

➤ Sergey Nikolaev commented:

What it can look like

{    
    "index" : "myindex", 
    "query": 
    { 
        "match_phrase": 
        { 
            "*" : "find me" 
        } 
        "options":     
        { 
            "agent_query_timeout": 100, 
            "boolean_simplify": 1, 
            "comment": "comment here", 
            "cutoff": 1000, 
            "expand_keywords": "exact", 
            "expand_keywords": 1, 
            "field_weights": 
            { 
                "title": 10, 
                "body": 3 
            }, 
            "global_idf": 1, 
            "idf": "normalized, tfidf_normalized" 
            "index_weights": 
            { 
                "idx1": 1, 
                "idx2": 2 
            }, 
            "local_df": 0, 
            "low_priority": 0, 
            "max_matches": 1000, 
            "max_query_time": 100, 
            "max_predicted_time": 100, 
            "morphology": "none", 
            "not_terms_only_allowed": 1, 
            "ranker": "expr('sum(lcs*user_weight)*1000+bm25')", 
            "rand_seed": 1234, 
            "retry_count": 5, 
            "retry_delay": 100, 
            "sort_method": "kbuffer", 
            "threads": 10, 
            "token_filter": "mylib.so:blend:@" 
        } 
    } 
} 

I.e. just direct mapping to the SQL form SELECT ... OPTIONS. Some of the options can later be implemented differently closer to the way it's done in Elasticsearch to make it easier to migrate from Elasticsearch to Manticore.

[githubmanticore]

➤ Sergey Nikolaev commented:

Or it may be better to have options outside of query:

{    
    "index" : "myindex", 
    "query": 
    { 
        "match_phrase": 
        { 
            "*" : "find me" 
        } 
    }, 
    "options":     
    { 
        "agent_query_timeout": 100, 
        "boolean_simplify": 1, 
        "comment": "comment here", 
        "cutoff": 1000, 
        "expand_keywords": "exact", 
        "expand_keywords": 1, 
        "field_weights": 
        { 
            "title": 10, 
            "body": 3 
        }, 
        "global_idf": 1, 
        "idf": "normalized, tfidf_normalized" 
        "index_weights": 
        { 
            "idx1": 1, 
             "idx2": 2 
        }, 
        "local_df": 0, 
        "low_priority": 0, 
        "max_matches": 1000, 
        "max_query_time": 100, 
        "max_predicted_time": 100, 
        "morphology": "none", 
        "not_terms_only_allowed": 1, 
        "ranker": "expr('sum(lcs*user_weight)*1000+bm25')", 
        "rand_seed": 1234, 
        "retry_count": 5, 
        "retry_delay": 100, 
        "sort_method": "kbuffer", 
        "threads": 10, 
        "token_filter": "mylib.so:blend:@" 
    } 
} 

[virtadpt]

options outside of query +1, here.

[githubmanticore]

➤ Ilya Kuznetsov commented:

Done in 368e7ca

boolean_simplify, low_priority and debug_no_payload were modified from

option low_priority 

to

option low_priority=1