CyanDev

I have a home lab setup where i separated my VMs , My devices and Others to different segments and vlans. I have setup firewall access for necessary communication which worked fine but when i setup Zabbix to monitor my systems there was a communication error. I troubleshoot it and found that it was probably because source ip showed vlan gateway ip instead of actual zabbix server's ip which caused agent to refuse connection. I assume this is because of segment NAT rule but disabling it for a segment cuts off all internet access . Does anyone have a suggestion on how to fix it without disabling isolation or breaking internet access?