Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 05:18
    lucperkins synchronize #9249
  • 05:12
    lucperkins review_requested #9249
  • 05:12
    lucperkins review_requested #9249
  • 05:11
    lucperkins edited #9249
  • 05:11
    lucperkins opened #9249
  • 04:32
    lucperkins edited #9248
  • 04:31
    lucperkins opened #9248
  • 04:09
    dependabot[bot] labeled #9247
  • 04:09
    dependabot[bot] opened #9247
  • 04:08
    dependabot[bot] labeled #9246
  • 04:08
    dependabot[bot] opened #9246
  • 04:08
    dependabot[bot] labeled #9245
  • 04:08
    dependabot[bot] opened #9245
  • 04:00
    lucperkins review_request_removed #9242
  • 04:00
    lucperkins review_requested #9242
  • 03:59
    lucperkins auto_merge_enabled #9242
  • 03:59
    lucperkins review_request_removed #9242
  • 03:59
    lucperkins auto_merge_enabled #9243
  • 03:58
    lucperkins edited #9244
  • 03:58
    lucperkins opened #9244
Vyacheslav Rakhinskiy
@rakhinskiy
Hi, how I can use custom grok patterns? for example https://github.com/padusumilli/postfix-grok/blob/master/postfix-grok-patterns
1 reply
Mark Klass
@ChristianKlass
Hello, is there a way to use Vector's transformation to "clean" the fields? For example, I used the tokenize transformation to get some of the values from some log, but now, I have values like {"protocol":":udp", "source_port":":57714->", etc}
Is there a way to clean them? Like removing the : in protocol and the : and -> in source_port?
Bindu-Mawat
@Bindu-Mawat
Hi I am using http source and when I start and stop my application multiple times(which restart vector as well each time), on client side I start getting error in connecting to vector: Error message:Connection refused (Connection refused)
Ghost
@ghost~5cd19fe2d73408ce4fbfa0bf
i'm tringto use vecto on my docker compose
but it can't catch the traffic on 5000 port
on my local machine
Jesse Szwedko
@jszwedko
Hi @Bindu-Mawat and @mikele_g_twitter ; just a note that community discussion and support has moved to discord: https://discord.gg/jm97nzy
Vyacheslav Rakhinskiy
@rakhinskiy
HI, how I can disable rate_limits on errors (I set drop_invalid to true for json_parser)?
For example
Nov 25 12:11:45.976 WARN transform{name=nginx_parse_json type=json_parser}: vector::internal_events::json: 19 "Event failed to parse as JSON" events were rate limited. rate_limit_secs=5
Vyacheslav Rakhinskiy
@rakhinskiy
And how I can debug this json? I start vector with LOG="trace" and can see only WARN for this event
Jesse Szwedko
@jszwedko
Hi @rakhinskiy ! Just a note that community discussion and support has moved to discord: https://discord.gg/jm97nzy
Vyacheslav Rakhinskiy
@rakhinskiy
@jszwedko ok thanks
Liem Le Hoang Duc
@liemle3893

Hi there, I'm stuck at write log to file with correct timezone.
[sinks.all]
inputs = ["in"]
type = "file"
path = "/tmp/%Y-%m-%d/%H.log"
encoding.codec = "text"


The time is UTC based where I need it in Local Timezone (+7 in my case). Is there anyway to achieve this with Vector? I've searched around but no luck.

Jesse Szwedko
@jszwedko
Hi @liemle3893 ! Just a note that community discussion and support has moved to discord: https://discord.gg/jm97nzy
1 reply
valerypetrov
@valerypetrov
Hey, guys. Does the vector is fips compatible?
avalenn
@avalenn:matrix.org
[m]
Hi @valerypetrov ! Just a note that community discussion and support has moved to discord: https://discord.gg/jm97nzy
valerypetrov
@valerypetrov
Thanks
Alexandre
@akalend
Hi
I have error unknown field transform
config:
[transform.del_fields]
type = "remap"
inputs = ["import_logs_tr"]
source = '''
.del(.file, .host)
.log = "import"
'''
this transform is as in docs
data before transform is:
{"file":"/var/log/app/app.log","host":"244f68ac3445","message":"num **213","severity":"import","source_type":"file","timestamp":"2021-05-19T13:06:18Z"}
Sanskar Gupta
@Sanskar95

Hi
I have a rust tcp server running at 4000, when I try to start the vector to get the tcp metrics am getting

ERROR source{component_kind="source" component_name=my_source_id component_type=socket}: vector::sources::util::tcp: Failed to bind to listener socket. error=TCP bind failed: Address already in use (os error 98)
Jun 23 22:47:43.438 ERROR source{component_kind="source" component_name=my_source_id component_type=socket}: vector::topology: An error occurred that vector couldn't handle.
Here is my vector.toml

[sources.my_source_id]
type = "socket"
address = "0.0.0.0:4000"
mode = "tcp"

[sinks.out]
inputs = ["my_source_id"]
type = "console"
encoding = "text"

adamwolfe-tc
@adamwolfe-tc

anyone have an example of a config for getting pod logs from a specific kubernetes namespace only? i'm trying

sources:
  kube_log_source:
    type: kubernetes_logs
    extra_field_selector: metadata.namespace==vector-testing

transforms:
  filter_on_namespace:
    type: filter
    inputs:
      - kube_log_source
    condition: .kubernetes.namespace == "vector-testing"

to no avail