49 Commits

Author SHA1 Message Date
Peter Marko
e3a6de1f94
fluentbit: fix aws-error-reporter package config
Compilation fails with several errors in flb_aws_error_reporter.c

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:25 -07:00
Peter Marko
878e7eed56
fluentbit: add profiles package config
Since the recipe tries to list every single option, add this one which
is missing. It is enabled by default in cmake to enabling it by default
in package config retains current settings.

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:25 -07:00
Peter Marko
9ee9a76ab8
fluentbit: fix shared-lib package config
Add library to packaged files to fix:

ERROR: fluentbit-3.2.8-r0 do_package: QA Issue: fluentbit: Files/directories were installed but not shipped in any package:
  /usr/lib/fluent-bit
  /usr/lib/fluent-bit/libfluent-bit.so
Please set FILES such that these items are packaged. Alternatively if they are unneeded, avoid installing them or delete them within do_install.
fluentbit: 2 installed and not shipped files. [installed-vs-shipped]

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:24 -07:00
Peter Marko
0edef1dadd
fluentbit: fix valgrind package config
Add valgrind dependency to fix:
fatal error: valgrind/valgrind.h: No such file or directory

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:24 -07:00
Peter Marko
05cc97c470
fluentbit: drop compiler optimization package configs
These manipulate compiler flags instead of using what yocto provides.
* "coverage" adds paths to binaries and thus causes buildpaths errors
* "small" strips binaries, so causes already-stripped error.
* DEBUG_BUILD is the correct way to enable debug/release flags in yocto

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:24 -07:00
Peter Marko
9850bfc551
fluentbit: upgrade 3.2.1 -> 3.2.8
Handle CVE-2024-50608 and CVE-2024-50609 (in 3.2.7).

Drop two patches addressed upstream.
Refresh remaining patches.
zstd is now bundled without possibility to unbundle.

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:24 -07:00
Peter Marko
f342e18d83
fluentbit: set UPSTREAM_CHECK_GITTAGREGEX
"devtool latest-version fluentbit" shows currently:
INFO: Latest version: 20220215
which is something old.

This change switches it to:
INFO: Latest version: 3.2.8
which was released on 2025-02-27.

Signed-off-by: Peter Marko <peter.marko@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2025-03-14 15:32:24 -07:00
Patrick Wicki
f57840b83b
fluentbit: use system libs instead of vendored ones
Make use of the new build option to unbundle some vendored dependencies.
Currently supported are libbacktrace, c-ares, jemalloc, luajit and
nghttp, all of which have Yocto recipes. librdkafka is currently below
the required version (>=2.3.0) so for that it will fall back to the
vendored version.

Signed-off-by: Patrick Wicki <patrick.wicki@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-11-29 15:25:42 -08:00
Patrick Wicki
0fdf559877
fluentbit: upgrade to v3.2.1
Changelogs since v3.1.9:

- https://fluentbit.io/announcements/v3.1.10/
- https://fluentbit.io/announcements/v3.2.0/
- https://fluentbit.io/announcements/v3.2.1/

Also add pending patch for a cprofiles bug.

Signed-off-by: Patrick Wicki <patrick.wicki@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-11-29 15:25:42 -08:00
Khem Raj
127e672ddf
fluentbit: Add IPO option as a packageconfig knob
LTO seems to fail when using clang compiler, therefore disable it for now.

| arm-yoe-linux-musleabi-ld.lld: error: undefined hidden symbol: co_swap_function.llvm.232435740610378447
| >>> referenced by arm.c:76 (lib/monkey/deps/flb_libco/arm.c:76)
| >>>               library/fluent-bit.lto.libfluent-bit.a(flb_input_thread.c.o at 1278594).o:(input_thread)
| >>> referenced by flb_input_thread.c:0 (src/flb_input_thread.c:0)
| >>>               library/fluent-bit.lto.libfluent-bit.a(flb_input_thread.c.o at 1278594).o:(input_thread)
| >>> referenced by arm.c:76 (lib/monkey/deps/flb_libco/arm.c:76)
| >>>               library/fluent-bit.lto.libfluent-bit.a(flb_output.c.o at 1447274).o:(.Lflb_output_task_flush$local)
| >>> referenced 88 more times

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-11-05 09:42:51 -08:00
Patrick Wicki
9ec4514267
fluentbit: fix building with wasm support
Patch the cmake config of the wasm micro runtime dependency. This fixes
the build for x86 by avoiding the cmake try_run() which cannot be
invoked in cross-compiling mode.

Signed-off-by: Patrick Wicki <patrick.wicki@siemens.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-21 20:54:48 -07:00
Niko Mauno
854cba9a25
fluentbit: Mitigate init manager detection issues
Avoid following CMake failure which during do_configure stemming from
non-cross compile friendly condition check executed on a build host
which has /usr/share/upstart directory

  | CMake Error at src/CMakeLists.txt:550 (install):
  |   install DIRECTORY given unknown argument "/etc/fluent-bit/".

Also handle systemd init manager case more appropriately, so that it
works also when the build host does not have a /lib/systemd/system
directory.

Signed-off-by: Niko Mauno <niko.mauno@vaisala.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-21 20:54:48 -07:00
Niko Mauno
1e0a0a6d5d
fluentbit: Upgrade recipe to 3.1.9
According to https://fluentbit.io/announcements/older-versions/

  Security Policy: support for current series ends three months after a new series is released.

Fluent Bit v1.9 Series has beel EOL since Dec 5, 2022, so upgrade the
recipe to currently supported / newest available version.

Relevant changelogs since previous 1.9.9 version of the component
 - https://fluentbit.io/announcements/v2.0.0/
 - https://fluentbit.io/announcements/v2.1.0/
 - https://fluentbit.io/announcements/v2.2.0/
 - https://fluentbit.io/announcements/v3.0.0/
 - https://fluentbit.io/announcements/v3.1.0/
 - https://fluentbit.io/announcements/v3.1.1/
 - https://fluentbit.io/announcements/v3.1.2/
 - https://fluentbit.io/announcements/v3.1.3/
 - https://fluentbit.io/announcements/v3.1.4/
 - https://fluentbit.io/announcements/v3.1.5/
 - https://fluentbit.io/announcements/v3.1.6/
 - https://fluentbit.io/announcements/v3.1.7/
 - https://fluentbit.io/announcements/v3.1.8/
 - https://fluentbit.io/announcements/v3.1.9/

Associated added PACKAGECONFIG knobs are described for the most part in
https://github.com/fluent/fluent-bit/blob/v3.1.9/CMakeLists.txt#L107-L167

The PACKAGECONFIG knobs are named according to the constant names used
in upstream source code. Please note that here the 'yaml' PACKAGECONFIG
option has changed to 'config-yaml', and instead of 'kafka' there is
now 'out-kafka'.

As a related side note, the plugin options are now defined in
https://github.com/fluent/fluent-bit/blob/v3.1.9/cmake/plugins_options.cmake

I have tested this change briefly against "qemuarm64" and "qemuppc"
machines that the fluent-bit systemd service starts successfully in
current master based core-image-minimal, and against "qemuarm" machine
using yoe/meta-clang based core-image-minimal. Also tested using an
i.MX6 board that the new Fluent Bit version seems to work as well as
it did with the old 1.9.9 version with respect to logging in a Yocto
Scarthgap based image.

Signed-off-by: Niko Mauno <niko.mauno@vaisala.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-10-10 12:53:50 -07:00
Khem Raj
1f2f07c30f
fluentbit: Make it deprecated
It does not build in a reproducible way that is now enforced by
yocto project. Fails with

WARNING: fluentbit-1.9.9-r0 do_package_qa: QA Issue: File /usr/bin/.debug/td-agent-bit in package fluentbit-dbg contains reference to TMPDIR [buildpaths]

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-08-19 19:18:30 -07:00
Khem Raj
de813392cf
fluentbit: Upgrade to 1.9.9
Disable incompatible-pointer-types warning as error to fix build
with gcc-14

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2024-05-12 08:43:19 -07:00
Martin Jansa
4f84234a27
fluentbit: drop ${PE}, ${PR} from /usr/src/debug paths
Signed-off-by: Martin Jansa <martin.jansa@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-11-20 09:30:38 -08:00
Martin Jansa
be8c765c7c *.patch: add Upstream-Status to all patches
There is new patch-status QA check in oe-core:
https://git.openembedded.org/openembedded-core/commit/?id=76a685bfcf927593eac67157762a53259089ea8a

This is temporary work around just to hide _many_ warnings from
optional patch-status (if you add it to WARN_QA).

This just added
Upstream-Status: Pending
everywhere without actually investigating what's the proper status.

This is just to hide current QA warnings and to catch new .patch files being
added without Upstream-Status, but the number of Pending patches is now terrible:

5 (26%) 	meta-xfce
6 (50%) 	meta-perl
15 (42%)        meta-webserver
21 (36%)        meta-gnome
25 (57%)        meta-filesystems
26 (43%)        meta-initramfs
45 (45%)        meta-python
47 (55%)        meta-multimedia
312 (63%)       meta-networking
756 (61%)       meta-oe

Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-06-21 09:15:20 -07:00
Khem Raj
344092438f fluentbit: Disable upstart scripts
They are not cross compile friendly as they poke into build host
directories to determine if system is upstart based and it can fail
build on such hosts e.g. ubuntu

If someone is still using upstart with OE then please fix it and send a
better fix upstream to re-enable it here.

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-03-23 18:31:10 -07:00
Peter Johennecken
827bce8217 fluentbit: change of download name
To prevent naming collisions when BB_GENERATE_MIRROR_TARBALLS is used,
the packagename is used for the downloaded file.

Otherwise it would just be source-${PV}.tar.gz

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-03-06 11:21:17 -08:00
Yi Zhao
4386b15a49 meta-oe: fix Upstream-Status format
Signed-off-by: Yi Zhao <yi.zhao@windriver.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-02-24 08:45:44 -08:00
Martin Jansa
e99f187966 .patch: fix Upstream-Status formatting issues reported by patchreview tool from oe-core
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-01-27 17:06:52 -08:00
Khem Raj
cd13881611 fluentbit: Link with libatomic on ppc32
We do not have 64bit atomics otherwise

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2023-01-08 15:34:08 -08:00
Khem Raj
3ab3b08ad9 fluentbit: Drop redundant patch
Instead of applying one and then reverting it via another patch, its
better to apply SRC_URI:remove on the original patch for x86 (32bit)

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-09-05 22:49:35 -07:00
Khem Raj
d1fb6cd8a5 fluentbit: Upgrade to 1.9.7 and fix build on x86
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-08-18 23:41:11 -07:00
Khem Raj
6c998191cd fluentbit: Use CMAKE_C_STANDARD_LIBRARIES cmake var to pass libatomic
Since libatomic needs to be linked last in the list of libs, take
advantange of using CMAKE_C_STANDARD_LIBRARIES insread of FLB_DEPS
since DFLB_DEPS is not appended last to linker flags in CMakefiles
it ends up with undefined references for libatomic symbols in libs
appearing after FLB_LIBS in sequence

Use it for mips too

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-08-18 23:41:11 -07:00
Khem Raj
bc2b1482a0 fluentbit: Fix build with musl
Pass large enough default for FLB_CORO_STACK_SIZE
Remove unused jemalloc patch

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-08-10 08:48:30 -07:00
Khem Raj
0f8dced8c7 fluentbit: Fix build with clang
Fix build using clang-15 which is even stricter then clang-14
These patches are worth upstream too

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Cc: Paulo Neves <ptsneves@gmail.com>
2022-08-10 08:48:26 -07:00
Paulo Neves
d09755e8e3 fluentbit Upgrade to 1.3.5 -> 1.9.6
Signed-off-by: Paulo Neves <ptsneves@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-08-06 09:12:15 -07:00
Khem Raj
f9a935ac8e fluentbit: Disable systemd support when systemd distro feature is disabled
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-04-25 12:10:11 -07:00
Khem Raj
ae8e0ae77f fluentbit: Fix build with usrmerge distro feature
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2022-04-25 10:44:09 -07:00
Martin Jansa
c61dc077bb Convert to new override syntax
This is the result of automated script (0.9.1) conversion:

oe-core/scripts/contrib/convert-overrides.py .

converting the metadata to use ":" as the override character instead of "_".

Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2021-08-03 10:21:25 -07:00
Ramon Fried
8cb6756a83 fluentbit: Fix SIGSEGV caused by using flb_free instead of mk_mem_free
Signed-off-by: Ramon Fried <rfried.dev@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2021-02-09 23:45:05 -08:00
Ramon Fried
f4521965f6 fluentbit: fix systemd input plugin
Because of missing dependency of systemd, Cmake configure
step didn't find systemd and skipped the systemd input plugin.
Added necessary dependency if systemd is available.

Signed-off-by: Ramon Fried <rfried.dev@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2021-02-09 23:45:05 -08:00
Khem Raj
9840748454 fluentbit: Link with libatomic on riscv32
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2020-11-16 19:14:38 -08:00
Khem Raj
608a92b4e6 fluentbit: Disable LTO
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2020-11-09 00:00:05 -08:00
Khem Raj
646429ef0a fluentbit: Use -fcommon to compile
gcc10+ defaults to -fno-common and fluentbit does not compile with
-fno-common

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2020-08-13 22:37:48 -07:00
Jacob Kroon
e921a2f251 meta-oe: Don't inherit 'features_check' in recipes that don't utilize it
Signed-off-by: Jacob Kroon <jacob.kroon@gmail.com>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2020-06-10 20:57:01 -07:00
Khem Raj
371b16a14e fluentbit: Link with libatomic on riscv
jemalloc uses libatomic functions

Fixes
../lib/libjemalloc_pic.a(extent_dss.pic.o): in function `extent_dss_extend
ing_start':
| /usr/src/debug/fluentbit/1.3.5-r0/fluent-bit-1.3.5/lib/jemalloc-5.2.1/src/extent_dss.c:75: undefined reference to `__atomic_compare
_exchange_1'

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2020-01-28 16:41:09 -08:00
Khem Raj
feb903f7d7 fluentbit: Fix build on powerpc
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2020-01-16 12:02:10 -08:00
Khem Raj
0b80ef1431 fluentbit: Upgrade to 1.3.5
Sync recipe with the one in sourcecode
Record Accessor feature requires Flex and Bison
fts dependency is needed on musl
Delete cmake_multilib.patch its fixed upstream
Use builtin nan funciton to avoid linking with libm

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2019-12-31 11:06:23 -08:00
Khem Raj
99fe1dec83 fluentbit: Fix packaging in multilib env
Fixes
ERROR: fluentbit-0.12.19-r0 do_package: QA Issue: fluentbit: Files/directories were installed but not shipped in any package:
/usr/lib/libfluent-bit.so
Please set FILES such that these items are packaged. Alternatively if they are unneeded, avoid installing them or delete them within do_install.

Signed-off-by: Khem Raj <raj.khem@gmail.com>
2019-12-20 16:07:50 -08:00
Adrian Bunk
61e306ad71 fluentbit: Upgrade 0.12.1 -> 0.12.19
Remove patch applied upstream.

Signed-off-by: Adrian Bunk <bunk@stusta.de>
Signed-off-by: Khem Raj <raj.khem@gmail.com>
2019-05-10 09:19:22 -07:00
Martin Jansa
c51d0b8f48 fluentbit: use Unix Makefiles OECMAKE generator
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
Signed-off-by: Armin Kuster <akuster808@gmail.com>
2018-01-26 17:29:50 -08:00
Khem Raj
8c037f68f9 fluentbit: Upgrade to 0.12.1
Drop upstreamed patches
Fix jemalloc build with musl
Fix linking errors due to missing -lpthread

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2017-09-13 11:13:22 +02:00
Martin Jansa
9a469d6826 fluentbit: fix SYSTEMD_SERVICE name
* the binary and service name was renamed in 0.11.11
  from fluent-bit to td-agent-bit, but unfortunately
  SYSTEMD_SERVICE wasn't updated in the recipe with
  the upgrade causing do_package failures as in:
  http://errors.yoctoproject.org/Errors/Details/147040/
  ERROR: SYSTEMD_SERVICE_fluentbit value fluent-bit.service does not exist

0.11.3-r0/image/
0.11.3-r0/image/etc
0.11.3-r0/image/etc/fluent-bit
0.11.3-r0/image/etc/fluent-bit/parsers.conf
0.11.3-r0/image/etc/fluent-bit/fluent-bit.conf
0.11.3-r0/image/lib
0.11.3-r0/image/lib/systemd
0.11.3-r0/image/lib/systemd/system
0.11.3-r0/image/lib/systemd/system/fluent-bit.service
0.11.3-r0/image/usr
0.11.3-r0/image/usr/bin
0.11.3-r0/image/usr/bin/fluent-bit
0.11.3-r0/image/usr/lib
0.11.3-r0/image/usr/lib/libfluent-bit.so
0.11.3-r0/image/usr/lib/pkgconfig
0.11.3-r0/image/usr/lib/pkgconfig/msgpack.pc

0.11.11-r0/image
0.11.11-r0/image/etc
0.11.11-r0/image/etc/td-agent-bit
0.11.11-r0/image/etc/td-agent-bit/parsers.conf
0.11.11-r0/image/etc/td-agent-bit/td-agent-bit.conf
0.11.11-r0/image/lib
0.11.11-r0/image/lib/systemd
0.11.11-r0/image/lib/systemd/system
0.11.11-r0/image/lib/systemd/system/td-agent-bit.service
0.11.11-r0/image/usr
0.11.11-r0/image/usr/bin
0.11.11-r0/image/usr/bin/td-agent-bit
0.11.11-r0/image/usr/lib
0.11.11-r0/image/usr/lib/libfluent-bit.so
0.11.11-r0/image/usr/lib/pkgconfig
0.11.11-r0/image/usr/lib/pkgconfig/msgpack.pc

Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2017-07-14 23:44:33 +02:00
Khem Raj
83dfe14491 fluentbit: Fix parallel build race
Sometimes with high parallism the build fails like below

| In file included from /mnt/a/oe/workspace/sources/fluentbit/include/fluent-bit/flb_thread_libco.h:24:0,
|                  from /mnt/a/oe/workspace/sources/fluentbit/include/fluent-bit/flb_thread.h:41,
|                  from /mnt/a/oe/workspace/sources/fluentbit/include/fluent-bit/flb_io.h:26,
|                  from /mnt/a/oe/workspace/sources/fluentbit/include/fluent-bit/flb_output.h:34,
|                  from /mnt/a/oe/workspace/sources/fluentbit/include/fluent-bit/flb_plugin_proxy.h:25,
|                  from /mnt/a/oe/workspace/sources/fluentbit/src/proxy/go/go.c:22:
| /mnt/a/oe/workspace/sources/fluentbit/include/fluent-bit/flb_mem.h:31:10: fatal error: jemalloc/jemalloc.h: No such file or directory
|  #include <jemalloc/jemalloc.h>
|           ^~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2017-07-14 23:43:21 +02:00
Khem Raj
905cdd0eac fluentbit: Upgrade to 0.11.11
Drop upstreamed patch

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2017-07-01 09:59:27 +02:00
Khem Raj
68c22d5bf1 fluentbit: Upgrade to 0.11.3 release
Fix cross compiling for external modules
Fix build with gcc7

Signed-off-by: Khem Raj <raj.khem@gmail.com>
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2017-04-26 20:13:30 +02:00
Eduardo Silva
c16b6e686b fluentbit: add new recipe
Fluent Bit is an open source data collector for Embedded Linux, this
patch adds the recipe for version 0.7.2.

  Project web site: http://fluentbit.io
  Documentation   : http://fluentbit.io/documentation/

Signed-off-by: Eduardo Silva <eduardo@monkey.io>
Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
2016-05-06 12:38:33 +02:00