Novel Method for Detecting Coughing Pigs with Audio-Visual Multimodality for Smart Agriculture Monitoring.

While the pig industry is crucial in global meat consumption, accounting for 34% of total consumption, respiratory diseases in pigs can cause substantial economic losses to pig farms. To alleviate this issue, we propose an advanced audio-visual monitoring system for the early detection of coughing, a key symptom of respiratory diseases in pigs, that will enhance disease management and animal welfare. The proposed system is structured into three key modules: the cough sound detection (CSD) module, which detects coughing sounds using audio data; the pig object detection (POD) module, which identifies individual pigs in video footage; and the coughing pig detection (CPD) module, which pinpoints which pigs are coughing among the detected pigs. These modules, using a multimodal approach, detect coughs from continuous audio streams amidst background noise and accurately pinpoint specific pens or individual pigs as the source. This method enables continuous 24/7 monitoring, leading to efficient action and reduced human labor stress. It achieved a substantial detection accuracy of 0.95 on practical data, validating its feasibility and applicability. The potential to enhance farm management and animal welfare is shown through proposed early disease detection.