How to use it for log analysis #1326
-
|
I have a log file named logs.log, the content of the file is such as 2023-08-02 14:30:45 INFO This is an informational log message. can you tell me how can I use manticore search to log analysis to support keyword search log and then displays the number of log lines containing specific keywords Thanks a lot |
Beta Was this translation helpful? Give feedback.
Replies: 6 comments 4 replies
-
|
Hi @WellYixuanDu, The dev version (which is currently a release candidate) offers enhanced support for: You can try using any of them to write data to Manticore. After that, you can use Apache Superset or Grafana to visualize your data. Support for Kibana and Opensearch dashboards is in the works. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for your help，but I'm still confused about this. My understanding of manticore search is that the data format of the log needs to be formatted and stored in the table. Do I need to convert the log of the text file into a formatted sql table through logstash, and then analyze it through manticore search, or both I am a little confused about the interface that can be shared between the two. Can you please give an example to explain it? Thank you very much |
Beta Was this translation helpful? Give feedback.
-
No.
Sure, please take this course https://play.manticoresearch.com/logstash/ |
Beta Was this translation helpful? Give feedback.
-
|
oh,thanks a lot, I have understand it, but I have a new question. I run the logstash,but it's error,the error information is "elasticsearch - Could not connect to a compatible version of Elasticsearch {:url=>"http://localhost:9308/"}" } output { |
Beta Was this translation helpful? Give feedback.
-
|
What's the Logstash version? |
Beta Was this translation helpful? Give feedback.
-
|
I changed the version, Now the version is 7.12.1,the problem now is I run sudo service manticore status, find now it's error root@6f3d5fdb3bb7:/data/task_code/search# sudo service manticore start [29:47.208] [1880] using config file '/etc/manticoresearch/manticore.conf' (273 chars)... but before I change the logstash version, it is running successfully, what's wrong with it |
Beta Was this translation helpful? Give feedback.
-
|
What's in the searchd log ( |
Beta Was this translation helpful? Give feedback.
-
|
[Wed Aug 2 15:59:48.652 2023] [11466] binlog: replaying log /var/lib/manticore/binlog/binlog.001 |
Beta Was this translation helpful? Give feedback.
-
means Manticore stopped right after it was started, that's why you can't connect to it. You probably didn't stop the previous version cleanly which left the binlog files and the more recent version can't read them. You can get back to the older version, start it and then stop it cleanly and then upgrade again. Or if you don't need the binlog, you can just remove the files ( |
Beta Was this translation helpful? Give feedback.
-
|
Thank you a lot, I solved it. |
Beta Was this translation helpful? Give feedback.
means Manticore stopped right after it was started, that's why you can't connect to it. You probably didn't stop the previous version cleanly which left the binlog files and the more recent version can't read them. You can get back to the older version, start it and then stop it cleanly and then upgrade again. Or if you don't need the binlog, you can just remove the files (
/var/lib/manticore/binlog/*) and restart Manticore.