Fish Detection and Classification using YOLOv8 for Automated Sorting Systems
DOI:
https://doi.org/10.24014/ijaidm.v7i2.30967Keywords:
Automatic Fish Sorting, Deep Learning, Fish Classification, Fish Harvest Technology, YOLOv8Abstract
Automation plays a crucial role in scaling up freshwater fish cultivation to address the future threat of food scarcity and meet growing nutrition needs. The fish industry, in particular, develops automation in the sorting and selection processes. However, research on this technology's development is still very limited. In this work, we propose an approach for detecting and classifying fish running on conveyors. We use YOLOv8, which is the most popular and newest deep learning model for object detection and classification. We conducted our test using the KMITLFish dataset, a moving conveyor belt recording that encompasses common cultivated freshwater fish in Thailand along with some endemic species. As a result, our proposed method was able to accurately detect and classify eight types of fish at a conveyor speed of 505.08 m/h. Moreover, we developed this work using a ready-to-use AI platform, intending to directly contribute to the advancement of automatic fish sorting system technology in the fish industry.References
V. M. Hazzard, K. A. Loth, L. Hooper, and C. B. Becker, "Food insecurity and eating disorders: A review of emerging evidence," Current psychiatry reports, vol. 22, pp. 1-9, 2020.
M. Thomas, D. P. Miller, and T. W. Morrissey, "Food insecurity and child health," Pediatrics, vol. 144, 2019.
D. Schanzenbach and A. Pitts, "How much has food insecurity risen? Evidence from the Census Household Pulse Survey," Institute for Policy Research Rapid Research Report, pp. 1-10, 2020.
A. Hossain, T. J. Krupnik, J. Timsina, M. G. Mahboob, A. K. Chaki, M. Farooq, et al., "Agricultural land degradation: processes and problems undermining future food security," in Environment, climate, plant and vegetation growth, ed: Springer, 2020, pp. 17-61.
A. D. Tripathi, R. Mishra, K. K. Maurya, R. B. Singh, and D. W. Wilson, "Estimates for world population and global food availability for global health," in The role of functional food security in global health, ed: Elsevier, 2019, pp. 3-24.
T. Hasegawa, G. Sakurai, S. Fujimori, K. Takahashi, Y. Hijioka, and T. Masui, "Extreme climate events increase risk of global food insecurity and adaptation needs," Nature Food, vol. 2, pp. 587-595, 2021.
H. El Bilali, I. H. N. Bassole, L. Dambo, and S. Berjan, "Climate change and food security," Agriculture & Forestry/Poljoprivreda i Sumarstvo, vol. 66, 2020.
D. Paudel, R. C. Neupane, S. Sigdel, P. Poudel, and A. R. Khanal, "COVID-19 Pandemic, Climate Change, and Conflicts on Agriculture: A Trio of Challenges to Global Food Security," Sustainability, vol. 15, p. 8280, 2023.
C. Wang, Z. Li, T. Wang, X. Xu, X. Zhang, and D. Li, "Intelligent fish farm—the future of aquaculture," Aquaculture International, pp. 1-31, 2021.
W.-S. Kim, W.-S. Lee, and Y.-J. Kim, "A review of the applications of the internet of things (IoT) for agricultural automation," Journal of Biosystems Engineering, vol. 45, pp. 385-400, 2020.
V. Puranik, A. Ranjan, and A. Kumari, "Automation in agriculture and IoT," in 2019 4th international conference on internet of things: smart innovation and usages (IoT-SIU), 2019, pp. 1-6.
M. S. A. Mahmud, M. S. Z. Abidin, A. A. Emmanuel, and H. S. Hasan, "Robotics and automation in agriculture: present and future applications," Applications of Modelling and Simulation, vol. 4, pp. 130-140, 2020.
A. Sartal, D. Carou, R. Dorado-Vicente, and L. Mandayo, "Facing the challenges of the food industry: Might additive manufacturing be the answer?," Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, vol. 233, pp. 1902-1906, 2018.
X. Yang, S. Zhang, J. Liu, Q. Gao, S. Dong, and C. Zhou, "Deep learning for smart fish farming: applications, opportunities and challenges," Reviews in Aquaculture, vol. 13, pp. 66-90, 2021.
G. Kaur, N. Adhikari, S. Krishnapriya, S. G. Wawale, R. Malik, A. S. Zamani, et al., "Recent Advancements in Deep Learning Frameworks for Precision Fish Farming Opportunities, Challenges, and Applications," Journal of Food Quality, vol. 2023, 2023.
D. Li and L. Du, "Recent advances of deep learning algorithms for aquacultural machine vision systems with emphasis on fish," Artificial Intelligence Review, vol. 55, pp. 4077-4116, 2022.
H. T. Rauf, M. I. U. Lali, S. Zahoor, S. Z. H. Shah, A. U. Rehman, and S. A. C. Bukhari, "Visual features based automated identification of fish species using deep convolutional neural networks," Computers and Electronics in Agriculture, vol. 167, p. 105075, 2019/12/01/ 2019.
S. Z. H. Shah, H. T. Rauf, M. IkramUllah, M. S. Khalid, M. Farooq, M. Fatima, et al., "Fish-Pak: Fish species dataset from Pakistan for visual features based classification," in Data in Brief vol. 27, D. i. Brief, Ed., ed: Data in Brief, 2019, p. 104565.
A. N.S, S. D, and R. K. S, "Naive Bayesian fusion based deep learning networks for multisegmented classification of fishes in aquaculture industries," Ecological Informatics, vol. 61, p. 101248, 2021/03/01/ 2021.
X. Xu, W. Li, and Q. Duan, "Transfer learning and SE-ResNet152 networks-based for small-scale unbalanced fish species identification," Computers and Electronics in Agriculture, vol. 180, p. 105878, 2021/01/01/ 2021.
S. A. Shammi, S. Das, M. Hasan, and S. R. H. Noori, "FishNet: Fish Classification using Convolutional Neural Network," in 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT), 2021, pp. 1-5.
A. Banerjee, A. Das, S. Behra, D. Bhattacharjee, N. T. Srinivasan, M. Nasipuri, et al., "Carp-DCAE: Deep convolutional autoencoder for carp fish classification," Computers and Electronics in Agriculture, vol. 196, p. 106810, 2022/05/01/ 2022.
A. Kuswantori, T. Suesut, W. Tangsrirat, and N. Nunak, "Development of object detection and classification with YOLOv4 for similar and structural deformed fish," EUREKA: Physics and Engineering, vol. 2, pp. 154–165, 2022.
M. A. Ahmed, M. S. Hossain, W. Rahman, A. H. Uddin, and M. T. Islam, "An advanced Bangladeshi local fish classification system based on the combination of deep learning and the internet of things (IoT)," Journal of Agriculture and Food Research, vol. 14, p. 100663, 2023/12/01/ 2023.
B. Gong, K. Dai, J. Shao, L. Jing, and Y. Chen, "Fish-TViT: A novel fish species classification method in multi water areas based on transfer learning and vision transformer," Heliyon, 2023.
A. Kuswantori, T. Suesut, W. Tangsrirat, G. Schleining, and N. Nunak, "Fish Detection and Classification for Automatic Sorting System with an Optimized YOLO Algorithm," Applied Sciences, vol. 13, p. 3812, 2023.
A. Kuswantori, T. Suesut, W. Tangsrirat, and S. Satthamsakul, "Fish Recognition Optimization in Various Backgrounds Using Landmarking Technique and YOLOv4," presented at the The 37th International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC), Phuket, Thailand, 05-08 July 2022.
J. Austen. (2024, 20/6/2024). What is YOLOv8? Exploring its Cutting-Edge Features. Available: https://yolov8.org/what-is-yolov8/
T. Diwan, G. Anirudh, and J. V. Tembhurne, "Object detection using YOLO: challenges, architectural successors, datasets and applications," Multimedia Tools and Applications, pp. 1-33, 2022.
P. Jiang, D. Ergu, F. Liu, Y. Cai, and B. Ma, "A Review of Yolo algorithm developments," Procedia Computer Science, vol. 199, pp. 1066-1073, 2022.
G. Jocher, A. Chaurasia, and J. Qiu. (2023, March, 24th). YOLO by Ultralytics. Available: https://github.com/ultralytics/ultralytics
M. Sohan, T. Sai Ram, and C. V. Rami Reddy, "A Review on YOLOv8 and Its Advancements," in Data Intelligence and Cognitive Informatics, Singapore, 2024, pp. 529-545.
Github. (2023, March, 24th). YOLOv8 by MMYOLO. Available: https://github.com/open-mmlab/mmyolo/tree/main/configs/yolov8
R. Jomtarak, C. Faikhamta, T. Prasoplarb, and K. Lertdechapat, "CiRA-Core: The Connector for Developer Teachers and User Teachers to Artificial Intelligence," in International Conference on Technology in Education, 2023, pp. 13-19.
