All Questions
38 questions
1
vote
0
answers
417
views
Failed to send log data to elastisearch via logstash
I'm new to ELK, when I tried to transfer log data using logstash is not working.I'm using
docker for ELK stack and log generated via a python script.pls check logstash.conf :
input {
udp {
...
- 71
1
vote
1
answer
1k
views
How to calculate lag between the time log message was generated at application end and the time it was ingested to Elastic Search?
Elasticsearch Experts, need your help to achieve the below mention goal.
Goal:
Trying to find a way to calculate lag between the time, log message was generated at application end (@timestamp field) ...
0
votes
1
answer
492
views
Elastic Stack (ELK) for multiple projects
I am new to Elastic Stack (ELK) and I am trying to set up the logging mechanism (ELK) for multiple projects with an optimal way.
The structure is as follows
2 - 5 projects, totally independent from ...
- 795
0
votes
0
answers
137
views
Why searching strings is such a struggle in elasticsearch?
Intro: (Feel free to skip it).
I`ve dealt in a casual way with elastic stack almost daily for the last couple of years as the two companies I worked for use it to aggregate logs. The problem is that ...
- 315
1
vote
0
answers
73
views
How to resolve "Bucket max cardinality estimate required for influencers host.name but not supplied" for machine learning job in Kibana
I'm currently setting up a machine learning job to detect rare events for host names. However I get the following error on the validation page of the job:
Job Validation Error
[Bucket max] ...
1
vote
1
answer
4k
views
How to dissect a log file with Filebeat that has multiple patterns?
I have trouble dissecting my log file due to it having a mixed structure therefore I'm unable to extract meaningful data.
A few example lines from my log:
2021.04.21 00:00:00.843 INF getBaseData: ...
- 21
1
vote
2
answers
2k
views
Archiving Log files from elasticSearch and bringing them back to minimize the storage cost
please I need some answers from experienced people since it's my first time using elastic stack (Internship). Assuming that I injected logs (coming from multiple servers apache nginx ...) in ...
- 153
0
votes
1
answer
1k
views
How to get elasticsearch index in sorted order from kibana console?
I want to fetch all the indexed logs file from elastic search in descending order of date from kibana.
Right now when I do:
GET _cate/indices
It gives me indices in random order as given below:
...
- 890
0
votes
0
answers
536
views
send angular application logs to elastic search
I am trying to send angular logs(exceptions, errors) to elastic search. so basically we have a planned to create a intermediate logging api that would push the data to elastic search. I have the API ...
- 2,042
1
vote
1
answer
665
views
How to get only one field from elasticsearch in the output?
{
"took": 5,
"timed_out": false,
"_shards": {
"total": 1,
"successful": 1,
"skipped": 0,
"failed&...
- 890
0
votes
1
answer
233
views
Container STDOUT to two separate ELS indexes
I have a containerised app that writes two categories of information to STDOUT as single line JSON. The first category is diagnostic logs (ERR/WARN etc) and the second is content access logs (...
- 13.3k
0
votes
1
answer
464
views
Migrating Elasticsearch logs to a different cluster
I have an Elasticsearch deployment on Kubernetes (AKS). I'm using the official Elastic's docker images for deployments. Logs are being stored in a persistent Azure Disk. How can I migrate some of ...
- 998
2
votes
1
answer
732
views
What would be the advantages of using ELK for log management over a simple python logging + existing database log table combo?
Assuming I have many Python processes running on an automation server such as Jenkins, let's say I want to use Python's native logging module and, other than writing to the Jenkins console or to a log ...
- 33
0
votes
2
answers
1k
views
ELK. Nested values are not found
I have index mapping like below:
{
"mapping": {
"properties": {
"MyMapProperty": {
"type": "nested",
"properties": {
"first": {
"type": "text",
...
- 923
0
votes
1
answer
735
views
how to get logs into logstash server without using filebeats
I have logstash installed in a server which will process logs and publish to elastic search. But, is it possible for logstash to pull logs from remote servers (linux) without installing filebeats in ...
- 39