Tuesday, March 15, 2022

[SOLVED] Should avahi-daemon be running on hadoop cluster machines?

Issue

We have hadoop cluster , hadoop version - 2.6.X & ambari version - 2.5.0.X

Should avahi-daemon service be disabled or enabled on hadoop cluster machines as ( master / workers / kafka )?

note - we want to disable this service especially on the data-node machines ( workers ), because we think this service could be the reason of OS restart,

for now this service is enable and running on all our machines in the hadoop cluster

reference - https://www.systutorials.com/docs/linux/man/8-avahi-daemon/

service avahi-daemon status
Redirecting to /bin/systemctl status  avahi-daemon.service
● avahi-daemon.service - Avahi mDNS/DNS-SD Stack
   Loaded: loaded (/usr/lib/systemd/system/avahi-daemon.service; enabled; vendor preset: enabled)
   Active: active (running) since Wed 2018-04-25 18:52:11 UTC; 17min ago

Note - I want to add that in /var/log/message file we see a million messages as

Apr 25 00:08:32 worker02 avahi-daemon[953]: Invalid response packet from host 91.61.42.241.
Apr 25 00:08:32 worker02 avahi-daemon[953]: Invalid response packet from host 91.61.60.61.
Apr 25 00:08:32 worker02 avahi-daemon[953]: Invalid response packet from host 91.61.35.160.
Apr 25 00:08:32 worker02 avahi-daemon[953]: Invalid response packet from host 91.61.22.128.
Apr 25 00:08:32 worker02 avahi-daemon[953]: Invalid response packet from host 91.61.56.231.

Solution

It should not hurt to disable them. It's not used by any Hadoop or Kafka protocol that I know of.

Its used for DNS, but hopefully you have some other DNS setup if you plan on turning it off.

You should rather try to find what hosts are in that 91.61.x.x range that are trying to communicate with your cluster though.



Answered By - OneCricketeer
Answer Checked By - Timothy Miller (WPSolving Admin)
at