azure activity log, how to find releases
My security department has asked to ingest logs from Azure with the goal being to identity releases. The security team wants to be able to say:Hey, there was a release on mm/dd/yyyy at noon (because we...
View ArticleRecommendations for complex log parsing and search
We have 2 hosted PBX server clusters that generate a lot of logs (~200GB/month total). We'd like to forward these logs to a server or application so that we can search the logs in a consolidated place,...
View ArticleLoki not getting my container logs
I have this config for loki to get all my container logs{- job_name: docker docker_sd_configs: - host: unix:///var/run/docker.sock refresh_interval: 5s relabel_configs: - source_labels:...
View Articleazure activity log, how to find releases
My security department has asked to ingest logs from Azure with the goal being to identity releases. The security team wants to be able to say:Hey, there was a release on mm/dd/yyyy at noon (because we...
View ArticlePromtail 3.4.4 parsing stages (regex, logfmt) not working with Docker service...
I'm experiencing an issue where Promtail 3.4.4 successfully ingests Docker container logs but all parsing stages (regex, logfmt, template) fail silently. Only basic pipeline stages like static_labels...
View Articleazure activity log, how to find releases
My security department has asked to ingest logs from Azure with the goal being to identity releases. The security team wants to be able to say:Hey, there was a release on mm/dd/yyyy at noon (because we...
View ArticleHow do I log ansible task output to a file?
One of my ansible tasks imports an Oracle database using impdp.This generates a lot of output to the console so I have set no_log: True.However, when this fails I want to see the log!How can I make...
View ArticleLimiting Access to logs on a specific cluster to Grafana Admins
I have 3 cluster (A-B-C), I installed loki on cluster A using the grafana/loki helm chart, and on cluster B and C I have promtail installed pushing logs to cluster A, how can I make logs collected from...
View Articlek9s only shows around 50-100 lines of logs, despite more logs being available
I've started using k9s, a TUI for exploring a kubernetes cluster.When I use it to view logs, it however only shows me around 50-100 lines, instead of all the logs, or at least a decent chunk of them....
View ArticleHow can I make AWS Elastic Beanstalk logs readable?
I just deployed to AWS - Elastic Beanstalk and found the logs undreadable. These are the logs directly downloaded from Elastic Beanstalk Environment GUI.Particularly, there is an ELB-Healthchecker...
View ArticleDocker log retrieval issue with local log driver
EDIT: this appears to be a problem with a long string of zeros getting dumped into the local logs; docker can't cope with this. Since sometimes the machine running our app loses power, when it comes...
View ArticleCollecting logs from Kubernetes container file system (not from stdout or...
I am trying to find a way to get Promtail collect logs from a container file system. These logs were not generated using the standard output, which automatically gets discovered by Promtail. They have...
View Articleazure activity log, how to find releases
My security department has asked to ingest logs from Azure with the goal being to identity releases. The security team wants to be able to say:Hey, there was a release on mm/dd/yyyy at noon (because we...
View ArticleWhat are the best logging/metrics reporting tools for use with OpenShift?
OpenShift includes EFK and I'm looking into using that or ELK, but there are so many options (found a link with 50+ options) that I'm trying to narrow down. Ideally something free/cheap. What is the...
View ArticleAutomatic periodic conditional checks
I need a simple tool that will carry out some conditional checks periodically and give me a red/green status that I can use as an indication that something is wrong.These are examples of checks that I...
View ArticleWhat considerations should be taken into account for a good log file format?
We have a practical question I struggle to answer : What is a good logfile schema?Here are the caveats:There are several workloads, each writing more than one log fileApplications are on more than one...
View ArticleView logrotated log continuously
Is there a command to view logrotated logs as a continuous stream with proper ordering?I need to view all entries in syslog in historical order starting from the oldest entry available. So far I was...
View ArticlePromtail vs. Grafana Agent
I'm running a couple of containers in a Docker Swarm and am setting up a logging system using Grafana Loki and Grafana (up to ~50GB/log per day max). For log shipping, I'm partly scraping container...
View ArticlePromtail does not sent logs after restarting the host
I have a Loki server that receives logs from other servers. The logs from containers have no problem(grafana/loki-docker-driver). However, other logs(Promtail) from log files are not updated after each...
View ArticleWhat considerations should be taken into account for a good log file format?
We have a practical question I struggle to answer : What is a good logfile schema?Here are the caveats:There are several workloads, each writing more than one log fileApplications are on more than one...
View Article