Commit graph

28634 commits

Author SHA1 Message Date
Thomas Haller
724ef83e06
platform: fix releasing thead-local stack of NMPNetns instances
Fixes: 12df49f8ab ('platform: make NMPNetns thread-safe')
(cherry picked from commit b433c21ae4)
2021-07-05 15:10:41 +02:00
Thomas Haller
963c395cc2
glib-aux: fix releasing thread-local storage from nm_strerror_native()
The previous implementation was just wrong.

Fixes: e1ca3bf7ed ('shared: add nm_strerror_native() to replace strerror() and g_strerror()')
(cherry picked from commit 5bc39d9783)
2021-07-05 15:10:40 +02:00
Thomas Haller
e83aad1972
glib-aux: add nm_utils_thread_local_register_destroy() helper
_nm_thread_local is very neat, but when we allocate resources
we need to make sure that they are destroyed when the thread
exits.

We can use pthread_setspecific() for that, but using it is cumbersome.
Add a helper function to make that simpler.

Also, the number of possible pthread_key_t keys is limited. With this
way, we only need one key in total.

(cherry picked from commit bec4a40437)
2021-07-05 15:10:33 +02:00
Thomas Haller
caea7ab56a
build: fix linking libnm-log-null into different test programs
We require these, otherwise we can get a linker error about
_nm_utils_monotonic_timestamp_initialized symbol being undefined.

(cherry picked from commit 09fb7877a9)
2021-07-05 15:09:52 +02:00
acabral
a636c25b59 bond: support the peer_notif_delay bond option
Merge Request NetworkManager/NetworkManager!913

(cherry picked from commit e5dca403dc)
2021-07-02 13:28:34 -03:00
Thomas Haller
7aa2214014
libnm: fix memleak setting "ipv[46].dhcp-iaid" property
Fixes: 56a1a5426a ('all: add ipvX.dhcp-iaid properties')
(cherry picked from commit 47cdcb3ce2)
2021-07-01 12:09:07 +02:00
Thomas Haller
f8766e8239
NEWS: update 2021-07-01 11:38:28 +02:00
Thomas Haller
ba0e61840d
core: merge branch 'th/keyfile-db-stale-entries'
https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/merge_requests/906

(cherry picked from commit 26f38b9ffa)
2021-07-01 11:33:57 +02:00
Thomas Haller
35402a7e90
settings: cleanup left over temporary files for timestamps/seen-bssids
(cherry picked from commit 34c663ca1a)
2021-07-01 11:33:57 +02:00
Thomas Haller
4b942e9519
glib-aux: add nm_key_file_db_prune_tmp_files() helper
(cherry picked from commit 3c0f1eb0fd)
2021-07-01 11:33:57 +02:00
Thomas Haller
567499cddd
glib-aux: add nm_utils_find_mkstemp_files()
(cherry picked from commit 080d765447)
2021-07-01 11:33:56 +02:00
Thomas Haller
006733d9b1
settings: prune old entries from keyfile databases
We have two GKeyfile files (timestamps and seen-bssids).

When a profile was deleted while NetworkManager was running, then
entries were removed from these keyfiles. But if a profile disappeared
while NetworkManger was stopped, then those UUIDs piled up.
This also happens if you have temporary connections in /run and reboot.

We need a way to garbage collect entries that are no longer relevant.

As the keyfile databases only get loaded once from disk, we will prune
all UUIDs for which we have no more connection loaded, on the first time
we write out the files again.

Note what this means: if you "temporarily" remove a connection profile
(without NetworkManager noticing) and restore it later, then the additional
information might have been pruned. There is no way how NetworkManager
could know that this UUID is coming back. The alternative is what we did
before: pile them up indefinitely. That seems more problematic.

(cherry picked from commit 2e720a1dc8)
2021-07-01 11:33:56 +02:00
Thomas Haller
697a445f6b
keyfile-aux: add nm_key_file_db_prune() helper
A helper function to remove entires that are no longer
relevant.

(cherry picked from commit f59def45c1)
2021-07-01 11:33:56 +02:00
Thomas Haller
1afc327c5d
settings: limit number of seen-bssids and preserve order
Previously, there was no limit how many seen-bssids are tracked.
That seems problematic, also because there is no API how to get
rid of an excessive list of entries.

We should limit the number of entries. Add an (arbitrary) limit
of 30.

But this means that we drop the surplus of entries, and for that it
seems important to keep the newest, most recently seen entries.
Previously, entries were merely sorted ASCIIbetically. Now, honor
their order (with most recently seen first).

Also, normalize the BSSIDs. From internal code, we should only get
normalize strings, but when we load them from disk, they might be bogus.
As we might cut of the list, we don't want that invalid entries
cut of valid ones. And of course, invalid entries make no sense at
all.

(cherry picked from commit 8278719840)
2021-07-01 11:33:56 +02:00
Thomas Haller
b31cafc4a4
settings: don't populate seen-bssids list from connection profile
ifcfg-rh plugin never stored the seen bssid list to file, and
keyfile no longer does, and it's no longer parsed from GVariant.

So there is actually no way how anything could be set here.

The seen-bssids should only be populate from
"/var/lib/NetworkManager/seen-bssids". Nowhere else.

(cherry picked from commit 15a0271781)
2021-07-01 11:33:56 +02:00
Thomas Haller
bb8481f101
libnm: special handle serialization to D-Bus for "wifi.seen-bssid"
"wifi.seen-bssid" is an unusual property, therefore very ugly due to the
inconsistency.

It is not a regular user configuration that makes sense to store to
disk or modify by the user. It gets populated by the daemon, and
stored in "/var/lib/NetworkManager/seen-bssids" file.

As such, how to convert this to/from D-Bus needs special handling.

This means, that the to/from D-Bus functions will only serialize the
property when the seen-bssids are specified via
NMConnectionSerializationOptions, which is what the daemon does.
Also, the daemon ignores seen-bssids when parsing the variant.

This has the odd effect that when the client converts a setting to
GVariant, the seen-bssids gets lost. That means, a conversion to GVariant
and back looses information. I think that is OK in this case, because the
main point of to/from D-Bus is not to have a lossless GVariant representation
of a setting, but to transfer the setting via D-Bus between client and
daemon. And transferring seen-bssids via D-Bus makes only sense from the daemon
to the client.

(cherry picked from commit 4a4f214722)
2021-07-01 11:33:56 +02:00
Thomas Haller
36eacd8528
libnm/keyfile: ignore [wifi].seen-bssids for keyfile
"seen-bssids" primarily gets stored to "/var/lib/NetworkManager/seen-bssids",
it's not a regular property.

We want this property to be serialized/deserialized to/from GVariant,
because we expose these settings on the API like a property of the
profile. But it cannot be modified via nmcli, it cannot be stored
to ifcfg files, and it makes not sense to store it to keyfile either.

Stop doing that.

(cherry picked from commit d9ebcc8646)
2021-07-01 11:33:56 +02:00
Thomas Haller
9e1d29d437
core: set _nm_utils_is_manager_process as first thing in daemon
(cherry picked from commit 6c5070da55)
2021-07-01 11:33:56 +02:00
Thomas Haller
29d64f148e
glib-aux: use NM_AUTO_PROTECT_ERRNO() in nm_auto_close and nm_auto_fclose
(cherry picked from commit f9f453994b)
2021-07-01 11:33:56 +02:00
Thomas Haller
309eba1078
std-aux/glib-aux: move NM_AUTO_PROTECT_ERRNO() to libnm-std-aux
(cherry picked from commit 2b55408cc7)
2021-07-01 11:33:56 +02:00
Thomas Haller
db744d2296
release: bump version to 1.32.3 (development) 2021-06-30 18:13:10 +02:00
Thomas Haller
bf1b09702e
release: bump version to 1.32.2 2021-06-30 18:13:10 +02:00
Thomas Haller
1216acefe8
NEWS: update 2021-06-30 17:14:31 +02:00
Thomas Haller
6a578faa24
libnm: document nm_ip_routing_rule_[gs]et_uid_range() as unusable
Fixes: 972d1ba046 ('libnm,core: support "uidrange" parameter for routing rules'):
2021-06-30 17:14:31 +02:00
Thomas Haller
af199191e6
libnm: fix crash in nm_ip_routing_rule_from_string()
import gi
    gi.require_version("NM", "1.0")
    from gi.repository import NM

    r = NM.IPRoutingRule.from_string('priority 10 type blackhole', NM.IPRoutingRuleAsStringFlags.AF_INET)
    r.to_string(NM.IPRoutingRuleAsStringFlags.NONE)

    r = NM.IPRoutingRule.from_string('priority 10 blackhole', NM.IPRoutingRuleAsStringFlags.AF_INET)
    r.to_string(NM.IPRoutingRuleAsStringFlags.NONE)

    r= NM.IPRoutingRule.from_string('priority 10 bogus', NM.IPRoutingRuleAsStringFlags.AF_INET)
    # CRASH

Fixes: e922404990 ('libnm,core: support "prohibit"/"blackhole"/"unreachable" type routing rules')
(cherry picked from commit 668c90dbb8)
2021-06-30 17:14:31 +02:00
Thomas Haller
7adbda7348
n-dhcp4: avoid maybe-uninitialized warning in n_dhcp4_c_connection_dispatch_io()
On RHEL-8.5, s390x with gcc-8.5.0-2.el8, we get a compiler warning:

  $ CFLAGS='-O2 -Werror=maybe-uninitialized' meson build
  ...
  cc -Isrc/libndhcp4-private.a.p -Isrc -I../src -Isubprojects/c-list/src -I../subprojects/c-list/src -Isubprojects/c-siphash/src -I../subprojects/c-siphash/src -Isubprojects/c-stdaux/src -I../subprojects/c-stdaux/src -fdiagnostics-color=always -pipe -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -std=c11 -g -D_GNU_SOURCE -O2 -Werror=maybe-uninitialized -fPIC -fvisibility=hidden -fno-common -MD -MQ src/libndhcp4-private.a.p/n-dhcp4-c-connection.c.o -MF src/libndhcp4-private.a.p/n-dhcp4-c-connection.c.o.d -o src/libndhcp4-private.a.p/n-dhcp4-c-connection.c.o -c ../src/n-dhcp4-c-connection.c
  ../src/n-dhcp4-c-connection.c: In function ‘n_dhcp4_c_connection_dispatch_io’:
  ../src/n-dhcp4-c-connection.c:1151:17: error: ‘type’ may be used uninitialized in this function [-Werror=maybe-uninitialized]
           uint8_t type;
                   ^~~~

https://github.com/nettools/n-dhcp4/pull/24
(cherry picked from commit 3a4822c52c)
2021-06-30 17:14:30 +02:00
Thomas Haller
9541b0bea4
cloud-setup: preserve IPv4 addresses/routes/rules from profile
nm-cloud-setup automatically detects routes, addresses and rules and configures them
on the device using the emphermal Reapply() API. That is, it does not modify the
existing profile (on disk), but changes the runtime configuration only.

As such, it used to wipe otherwise statically configured IP addresses, routes and
rules. That seems unnecessary. Let's keep the configuration from the (persistent)
configuration.

There is of course the problem that nm-cloud-setup doesn't really
understand the existing IP configuration, and it can only hope that
it can be meaningfully combined with what nm-cloud-setup wants to
configure. This should cover most simple cases, for more complex setups,
the user probably should disable nm-cloud-setup and configure the
network explicitly to their liking.

https://bugzilla.redhat.com/show_bug.cgi?id=1971527

https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/merge_requests/893
(cherry picked from commit 4201ee5119)
2021-06-30 08:05:16 +02:00
Julian Wiedmann
f1196cb26e
nm-initrd-generator: document support for rd.znet option
rd.znet support was added with commit 11d4412ee1 ("process s390
specific device info from rd.znet parameter in nm-initrd-generator").

Signed-off-by: Julian Wiedmann <jwi@linux.ibm.com>

https://github.com/NetworkManager/NetworkManager/pull/362
(cherry picked from commit 6bc6d45925)
2021-06-28 14:02:00 +02:00
Thomas Haller
0e6d4a99db
ifcfg-rh: merge branch 'th/ifcfg-fix-empty-ethtool'
https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/merge_requests/905

(cherry picked from commit f9040c3cca)
2021-06-28 13:30:33 +02:00
Thomas Haller
364bc8d737
ifcfg-rh: fix persisting all-default NMSettingEthtool settings
We somehow need to encode an NMSettingEthtool instance that has all
options unset. Previously, that would result in no "$ETHTOOL_OPTS"
variable and thus the reader would loose a previously existing setting.

Hack it by writing a bogus

  ETHTOOL_OPTS="-A $IFACE"

line.

(cherry picked from commit 26ed9e6714)
2021-06-28 13:30:32 +02:00
Thomas Haller
e78d9535a8
ifcfg-rh/tests: add unit test for persisting NMSettingEthtool
In particular the case with an all-default NMSettingEthtool is
currently broken. The test is checking the wrong behavior, which
will be fixed next.

(cherry picked from commit ef0f9b871b)
2021-06-28 13:30:31 +02:00
Thomas Haller
85ddfc8959
ifcfg-rh/tests: unlink test file in _writer_new_connection_reread() if not requested
(cherry picked from commit 3fdedde16f)
2021-06-28 13:30:31 +02:00
Thomas Haller
842db82686
ifcfg-rh/tests: evalute environment for $NMTST_IFCFG_RH_UPDATE_EXPECTED only once
It just seems ugly to call g_getenv() repeatedly. Environment variables
must not change (in a multi-threaded program after other threads start),
so determine the mode once and cache it.

(cherry picked from commit 1ae6719cf1)
2021-06-28 13:30:31 +02:00
Thomas Haller
b425793d90
ifcfg: always write ethernet.s390-options even without subchannels
For the umpteenth time: it is not ifcfg-rh writers decision to decide
what are valid configurations and only persist settings based on
some other settings.

If s390-options would only be allowed together with subchannels, then
this is alone nm_connection_verify()'s task to ensure.

Reproduce with

  $ nmcli connection add type ethernet autoconnect no con-name zz ethernet.s390-options bridge_role=primary

Related: https://bugzilla.redhat.com/show_bug.cgi?id=1935842

Fixes: 16bccfd672 ('core: handle s390 options more cleanly')
(cherry picked from commit d391f20730)
2021-06-25 11:26:34 +02:00
Thomas Haller
b5de7b2e48
supplicant: suppress warning log for P2PDevice.Cancel()
A failure to cancel something is not worth a warning. It probably
just means that no operation was in progress. In my logs I always
see a warning:

    CODE_FILE=src/core/supplicant/nm-supplicant-interface.c
    CODE_LINE=391
    MESSAGE=<warn>  [1624517233.8822] sup-iface[a22b181a321ffd9b,9,wlan0]: call-p2p-cancel: failed with P2P cancel failed

Downgrade this to trace level.

(cherry picked from commit 476598ca99)
2021-06-24 11:15:04 +02:00
Thomas Haller
056f69198f
gitlab-ci: bump tag for cached container images
This results in a rebuild of the containers, which is a good idea as we
didn't do that for a while.

(cherry picked from commit aba1754a80)
2021-06-23 21:08:15 +02:00
Thomas Haller
0432c2bcdb
trivial: fix code formatting
Fixes: ac090edd87 ('libnm: add type enum for handling gprop differences in to_dbus_fcn')
(cherry picked from commit 6ac304b673)
2021-06-23 14:58:53 +02:00
Thomas Haller
11fd85b3e1
libnm: merge branch 'th/setting-to-dbus-fcn'
https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/merge_requests/900

(cherry picked from commit 74996782eb)
2021-06-23 13:02:34 +02:00
Thomas Haller
17fab764fc
libnm: use _nm_setting_property_define_string() for string NMSetting properties
(cherry picked from commit a3eb2c7026)
2021-06-23 13:02:30 +02:00
Thomas Haller
2e93f82746
libnm: use _nm_setting_property_define_boolean() for boolean NMSetting properties
(cherry picked from commit 22edf34ba3)
2021-06-23 13:02:28 +02:00
Thomas Haller
1cc3b9c753
libnm: use new including_default flag and boolean getter for "ethernet.auto-negotiate" property
(cherry picked from commit d5c4378cdf)
2021-06-23 13:02:27 +02:00
Thomas Haller
4cea3e4f44
libnm: add flag to control whether to_dbus_fcn() should handle default values
Usually, properties that are set to their default are not serialized on
D-Bus. That is, to_dbus_fcn() returns NULL.

In some cases, we explicitly want to always serialize the property. For
example, if we changed behavior and the libnm default value changed.
Then we want that the message on D-Bus is always clear about the used
value and not rely on the default value on the receiving side.

(cherry picked from commit acc3a66bf2)
2021-06-23 13:02:26 +02:00
Thomas Haller
b20941215e
libnm: extend to_dbus_fcn() property type for efficiently converting string property
(cherry picked from commit e435fdfedf)
2021-06-23 13:02:24 +02:00
Thomas Haller
7598eb6228
libnm: extend to_dbus_fcn() property type for efficiently converting boolean property
Most of our NMSetting properties are based around GObject properties,
and thus the tooling to convert a NMSetting to/from GVariant consists
of getting/setting a GValue.

We can do better.

For most of such properties we also define a C getter function, which
we can call with less overhead. All we need is to hook the C getter with
the property meta data.

As example, implement it for "connection.autoconnect".

The immediate goal of this is to reduce the overhead of to_dbus. But
note that also for comparison of two properties, there is the default
implementation which is used by the majority of properties. This
implementation converts the properties first to GVariant (via
to_dbus_fcn) and then compares the variants. What this commit also does,
is to hook up the property meta data with the C-getters. This is one step
towards also more efficiently compare properties using the naive C
getters. Likewise, the keyfile writer use g_object_get_property().
It also could do better.

(cherry picked from commit a832781a8a)
2021-06-23 13:02:23 +02:00
Thomas Haller
8416c42b9d
libnm: move gprop_to_dbus_fcn hook to NMSettInfoProperty
For each property we have meta data in form of NMSettInfoProperty.
Each meta data also has a NMSettInfoProperty.property_type
(NMSettInfoPropertType).

The property type is supposed to define common behaviors for properties,
while the property meta data has individual properties. The idea is that
several properties can share the same property-type, and that
per-property meta data is part of NMSettInfoProperty.

The distinction is not very strong, but note that all remaining uses
of NMSettInfoPropertType.gprop_to_dbus_fcn were part of a property
type that was only used for one single property. That lack of
reusability hints to a wrong use.

Move gprop_to_dbus_fcn to the property meta data as a new field
NMSettInfoProperty.to_dbus_data.

Note that NMSettInfoPropertType.gprop_from_dbus_fcn still suffers from
the same problem. But the from-dbus side is not yet addressed.

(cherry picked from commit 54cab39ac9)
2021-06-23 13:02:22 +02:00
Thomas Haller
7af962b330
libnm: change "nm_sett_info_propert_type_mac_address" to use gprop_type for to_dbus_fcn()
(cherry picked from commit ed57990b58)
2021-06-23 13:02:21 +02:00
Thomas Haller
7f21fbad31
libnm: change "nm_sett_info_propert_type_strdict" to use gprop_type for to_dbus_fcn()
(cherry picked from commit 6d39014660)
2021-06-23 13:02:20 +02:00
Thomas Haller
97a25c5965
libnm: change "nm_sett_info_propert_type_dcb_au" to use gprop_type for to_dbus_fcn()
(cherry picked from commit 8c0a8a6d9b)
2021-06-23 13:02:19 +02:00
Thomas Haller
3dfd563601
libnm: add type enum for handling gprop differences in to_dbus_fcn
For GBytes, GEnum, GFlags and others, we need special converters from the
default GObject properties to GVariant.

Previously, those were implemented by providing a special
gprop_to_dbus_fcn hook. But gprop_to_dbus_fcn should move
from NMSettInfoPropertType to NMSettInfoProperty, because it's
usually a per-property meta data, and not a per-property-type meta data.
The difference is whether the meta data can be shared between different
properties (of the same "type).

In these cases, this extra information is indeed part of the type.
We want to have a generic NM_SETT_INFO_PROPERT_TYPE_GPROP() property
(using _nm_setting_property_to_dbus_fcn_gprop()), but then we would like
to distinguish between special cases. So this was fine.

However, I find the approach of providing a gprop_to_dbus_fcn in this
case cumbersome. It makes it harder to understand what happens. Instead,
introduce a new "gprop_type" for the different types that
_nm_setting_property_to_dbus_fcn_gprop() can handle.

This new "gprop_type" is extra data of the property type, so
introduce a new field "typdata_to_dbus".

(cherry picked from commit ac090edd87)
2021-06-23 13:02:19 +02:00
Thomas Haller
d2e0a8cc0e
libnm: add and use NM_SETT_INFO_PROPERT_TYPE_*_INIT() macros
The advantage is that we use similar macros for initializing the
static structs like

   const NMSettInfoPropertType nm_sett_info_propert_type_cloned_mac_address;

and the ad-hoc locations that use NM_SETT_INFO_PROPERT_TYPE().

The former exist for property types that are used more than once.
The latter exist for convenience, where a property type is implemented
at only one place.

Also, there are few direct references to _nm_setting_property_to_dbus_fcn_gprop().
all users use NM_SETT_INFO_PROPERT_TYPE_GPROP() or
NM_SETT_INFO_PROPERT_TYPE_GPROP_INIT().

(cherry picked from commit 6fc2e03677)
2021-06-23 13:02:18 +02:00