下载地址:
https://www.elastic.co/cn/downloads/logstash
华为:https://mirrors.huaweicloud.com/
下载最MovieLens最小测试数据集:https://grouplens.org/datasets/movielens/
新建配置文件logstash.conf:
#修改movielens目录下的logstash.conf文件
#path修改为,你实际的movies.csv路径
input {
file {
path => "/usr/local/logstash-7.5.1/testfile/ml-latest-small/movies.csv"
start_position => "beginning"
sincedb_path => "/dev/null" #表示每次重新加载文件数据
}
}
output {
elasticsearch {
hosts => [ "10.5.250.168:9200" ]
}
}
# Sample Logstash configuration for creating a simple # Beats -> Logstash -> Elasticsearch pipeline. #input { # beats { # port => 5044 # } #} input { file { path => "/usr/local/logstash-7.5.1/testfile/ml-latest-small/movies.csv" start_position => "beginning" sincedb_path => "/dev/null" } } output { elasticsearch { hosts => [ "10.5.250.168:9200" ] } } #output { # elasticsearch { # hosts => ["http://localhost:9200"] # index => "%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}" #user => "elastic" #password => "changeme" # } #}
启动:
#启动Elasticsearch实例,然后启动 logstash,并制定配置文件导入数据
bin/logstash -f /usr/local/logstash-7.5.1/config/logstash.conf
图中表明启动成功