最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

c# - Elastic.Serilog.Sinks events and pipe;ines - Stack Overflow

programmeradmin0浏览0评论

I am using Elastic.Serilog.Sinks to stream some data directly to elasticsearch a very simple mechanism

  .WriteTo.Logger(lc =>
        {
            lc.Filter.ByIncludingOnly(le => le.Properties.ContainsKey("ecs.version"))
              .WriteTo.Elasticsearch(
                  new[] { new Uri("http://localhost:9200") },
                  opts =>
                  {
                      opts.DataStream = new DataStreamName("logs", entryAssembly.GetName().Name!.ToLowerInvariant());
                      opts.BootstrapMethod = BootstrapMethod.Failure;
                      opts.ConfigureChannel = channelOpts =>
                      {
                          channelOpts.BufferOptions = new BufferOptions { ExportMaxConcurrency = 10 };
                      };
                  },
                  _ =>
                  {
                      // No authentication
                  });
        })

thing is it created addtitional fields i doint need and want like agent.type and so on. I thought i can create blacklist pipeline something like

private static async Task IngestPipeline()
{
    var pipelineDefinition = new
    {
        description = "Removes ECS fields we don't want",
        processors = new object[]
        {
            new
            {
                remove = new
                {
                    field = new[]
                    {
                        "agent.type",
                        "agent.version",
                        "data_stream.type"
                    },
                    ignore_missing = true
                }
            }
        }
    };

    string json = JsonConvert.SerializeObject(pipelineDefinition);
    using var httpClient = new HttpClient();
    var requestContent = new StringContent(json, Encoding.UTF8, "application/json");

    string pipelineUrl = "http://localhost:9200/_ingest/pipeline/remove_ecs_fields";

    using HttpResponseMessage response = await httpClient.PutAsync(pipelineUrl, requestContent);
    response.EnsureSuccessStatusCode();
}

but is there some event trigger in ElasticsearchSinkOptions I can use to execute it?

for example:

opts.Pipeline = "remove_ecs_fields";
发布评论

评论列表(0)

  1. 暂无评论
ok 不同模板 switch ($forum['model']) { /*case '0': include _include(APP_PATH . 'view/htm/read.htm'); break;*/ default: include _include(theme_load('read', $fid)); break; } } break; case '10': // 主题外链 / thread external link http_location(htmlspecialchars_decode(trim($thread['description']))); break; case '11': // 单页 / single page $attachlist = array(); $imagelist = array(); $thread['filelist'] = array(); $threadlist = NULL; $thread['files'] > 0 and list($attachlist, $imagelist, $thread['filelist']) = well_attach_find_by_tid($tid); $data = data_read_cache($tid); empty($data) and message(-1, lang('data_malformation')); $tidlist = $forum['threads'] ? page_find_by_fid($fid, $page, $pagesize) : NULL; if ($tidlist) { $tidarr = arrlist_values($tidlist, 'tid'); $threadlist = well_thread_find($tidarr, $pagesize); // 按之前tidlist排序 $threadlist = array2_sort_key($threadlist, $tidlist, 'tid'); } $allowpost = forum_access_user($fid, $gid, 'allowpost'); $allowupdate = forum_access_mod($fid, $gid, 'allowupdate'); $allowdelete = forum_access_mod($fid, $gid, 'allowdelete'); $access = array('allowpost' => $allowpost, 'allowupdate' => $allowupdate, 'allowdelete' => $allowdelete); $header['title'] = $thread['subject']; $header['mobile_link'] = $thread['url']; $header['keywords'] = $thread['keyword'] ? $thread['keyword'] : $thread['subject']; $header['description'] = $thread['description'] ? $thread['description'] : $thread['brief']; $_SESSION['fid'] = $fid; if ($ajax) { empty($conf['api_on']) and message(0, lang('closed')); $apilist['header'] = $header; $apilist['extra'] = $extra; $apilist['access'] = $access; $apilist['thread'] = well_thread_safe_info($thread); $apilist['thread_data'] = $data; $apilist['forum'] = $forum; $apilist['imagelist'] = $imagelist; $apilist['filelist'] = $thread['filelist']; $apilist['threadlist'] = $threadlist; message(0, $apilist); } else { include _include(theme_load('single_page', $fid)); } break; default: message(-1, lang('data_malformation')); break; } ?>