Pertanika Journal of Science & Technology
Pertanika Journal Home Facebook
Pertanika · Universiti Putra Malaysia Press

Pertanika Journal of Science & Technology

Official journal of Universiti Putra Malaysia for scholarly work across science, engineering and related technologies.

e-ISSN 2231-8526 ISSN 0128-7680
Research article

Super-Resolution Approach to Enhance Bone Marrow Trephine Image in the Classification of Classical Myeloproliferative Neoplasms

Umi Kalsom Mohamad Yusof, Syamsiah Mashohor, Marsyita Hanafi, Sabariah Md Noor and Norsafina Zainal

https://doi.org/10.47836/pjst.31.5.02
KeywordsArtificial intelligence, histopathology images, image reconstruction, myeloproliferative neoplasm, super-resolution
Article content

Abstract

Many diseases require histopathology images to characterise biological components or study cell and tissue architectures. The histopathology images are also essential in supporting disease classification, including myeloproliferative neoplasms (MPN). Despite significant developments to improve the diagnostic tools, morphological assessment from histopathology images obtained by bone marrow trephine (BMT) remains crucial to confirm MPN subtypes. However, the assessment outcome is challenging due to subjective characteristics that are hard to replicate due to its inter-observer variability. Apart from that, image processing may reduce the quality of the BMT images and affect the diagnosis result. This study has developed a classification system for classical MPN subtypes: polycythemia vera (PV), essential thrombocythemia (ET), and primary myelofibrosis (MF). It was done by reconstructing low-resolution images of BMT using a super-resolution approach to address the issue. Identified low-resolution images from calculating Laplacian variance were reconstructed using a super-resolution convolution neural network (SRCNN) to transform into rich information of high-resolution images. Original BMT images and reconstructed BMT images using the SRCNN dataset were fed into a CNN classifier, and the classifier’s output for both datasets was compared accordingly. Based on the result, the dataset consisting of the reconstructed images showed better output with 92% accuracy, while the control images gave 88% accuracy. In conclusion, the high quality of histopathology images substantially impacts disease process classification, and the reconstruction of low-resolution images has improved the classification output.
Supporting literature

References

  1. Ali, U., & Mahmood, M. T. (2018). Analysis of blur measure operators for single image blur segmentation. Applied Sciences, 8(5), Article 807. https://doi.org/10.3390/app8050807
  2. Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021). Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8, Article 53. https://doi.org/10.1186/s40537-021-00444-8
  3. Arber, D. A., Orazi, A., Hasserjian, R., Thiele, J., Borowitz, M. J., Le Beau, M. M., Bloomfield, C. D., Cazzola, M., & Vardiman, J. W. (2016). The 2016 revision to the World Health Organization classification of myeloid neoplasms and acute leukemia. Blood, 127(20), 2391-2405. https://doi.org/10.1182/blood-2016-03-643544
  4. Barbui, T., Thiele, J., Gisslinger, H., Kvasnicka, H. M., Vannucchi, A. M., Guglielmelli, P., Orazi, A., & Tefferi, A. (2018). The 2016 WHO classification and diagnostic criteria for myeloproliferative neoplasms: document summary and in-depth discussion. Blood Cancer Journal, 8, Article 15. https://doi.org/10.1038/s41408-018-0054-y
  5. Chen, Y., Wang, J., Chen, X., Sangaiah, A. K., Yang, K., & Cao, Z. (2019). Image super-resolution algorithm based on dual-channel convolutional neural networks. Applied Sciences, 9(11), Article 2316. https://doi.org/10.3390/app9112316 (Retraction published 2021, Applied Sciences, 11(20), Article 9442)
  6. Cheng, Z., Sun, H., Takeuchi, M., & Katto, J. (2018). Performance comparison of convolutional autoencoders, generative adversarial networks and super-resolution for image compression. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 2613-2616). Computer Vision Foundation. https://doi.org/10.48550/arXiv.1807.00270
  7. Dameshek, W. (1951). Some speculations on the myeloproliferative syndromes. Blood, 6(4), 372-375. https://doi.org/10.2307/j.ctvcszzbq.35
  8. Dodge, S., & Karam, L. (2016). Understanding how image quality affects deep neural networks. In 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX) (pp. 1-6). IEEE Publishing. https://doi.org/10.1109/QoMEX.2016.7498955
  9. Hasserjian, R. P. (2018). Changes in the World Health Organization 2016 classification of myeloid neoplasms everyone should know. Current Opinion in Hematology, 25(2), 120-128. https://doi.org/10.1097/MOH.0000000000000404
  10. Hayat, K. (2018). Multimedia super-resolution via deep learning: A survey. Digital Signal Processing, 81, 198-217. https://doi.org/10.1016/j.dsp.2018.07.005
  11. Hou, J., Si, Y., & Yu, X. (2020). A novel and effective image super-resolution reconstruction technique via fast global and local residual learning model. Applied Sciences, 10(5), Article 1856. https://doi.org/10.3390/app10051856
  12. Huang, R., Feng, W., Fan, M., Wan, L., & Sun, J. (2018). Multiscale blur detection by learning discriminative deep features. Neurocomputing, 285, 154-166. https://doi.org/10.1016/j.neucom.2018.01.041
  13. Jain, P. A., & Kosamkar, P. K. (2022). Analysis and prediction of COVID-19 with image super-resolution using CNN and SRCNN-Based approach. In T. Senjyu, P. N. Mahalle, T. Perumal & A. Joshi (Eds.), Smart Innovation, Systems and Technologies: Vol. 248. ICT with Intelligent Applications (pp. 33-40). Springer. https://doi.org/10.1007/978-981-16-4177-0_5
  14. Leena, M. F., & Sreenath, N. (2019). Pre-processing techniques for detection of blurred images. In N. Chaki, N. Devarakonda, A. Sarkar & N. Debnath (Eds.). Lecture Notes on Data Engineering and Communications Technologies: Vol. 28. Proceedings of International Conference on Computational Intelligence and Data Engineering (pp. 59-66). Springer. https://doi.org/10.1007/978-981-13-6459-4_7
  15. Loey, M., Naman, M., & Zayed, H. (2020). Deep transfer learning in diagnosing leukemia in blood cells. Computers, 9(2), Article 29. https://doi.org/10.3390/computers9020029
  16. Mariam, K., Afzal, O. M., Hussain, W., Javed, M. U., Kiyani, A., Rajpoot, N., Khurram, S. A., & Khan, H. A. (2022). On smart gaze based annotation of histopathology images for training of deep convolutional neural networks. IEEE Journal of Biomedical and Health Informatics, 26(7), 3025-3036. https://doi.org/10.1109/JBHI.2022.3148944
  17. Parsania, P. S., & Virparia, P. V. (2016). A comparative analysis of image interpolation algorithms. International Journal of Advanced Research in Computer and Communication Engineering, 5(1), 29-34. https://doi.org/10.17148/ijarcce.2016.5107
  18. Rahaman, M. A., Chen, J., Fu, Z., Lewis, N., Iraji, A., & Calhoun, V. D. (2021). Multi-modal deep learning of functional and structural neuroimaging and genomic data to predict mental illness. In 2021 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 3267-3272). IEEE Publishing. https://doi.org/10.1109/EMBC46164.2021.9630693
  19. Sirinukunwattana, K., Aberdeen, A., Theissen, H., Sousos, N., Psaila, B., Mead, A. J., Turner, G. D. H., Rees, G., Rittscher, J., & Royston, D. (2019). Improving the diagnosis and classification of ph-negative myeloproliferative neoplasms through deep phenotyping. BioRxiv. https://doi.org/10.1101/762013
  20. Talo, M. (2019). Automated classification of histopathology images using transfer learning. Artificial Intelligence in Medicine, 101, Article 101743. https://doi.org/10.1016/j.artmed.2019.101743
  21. Taş, M., & Yılmaz, B. (2021). Super resolution convolutional neural network based pre-processing for automatic polyp detection in colonoscopy images. Computers and Electrical Engineering, 90, Article 106969. https://doi.org/10.1016/j.compeleceng.2020.106959
  22. Tavares, R. S., Nonino, A., Pagnano, K. B. B., Nascimento, A. C. K. V. d, Conchon, M., Fogliatto, L. M., Funke, V. A. M., Bendit, I., Clementino, N. C. D., Chauffaille, M. d. L. L. F., Bernardo, W. M., & de Souza Santos, F. P. (2019). Guideline on myeloproliferative neoplasms: Associacão Brasileira de Hematologia, Hemoterapia e Terapia Cellular: Project guidelines: Associação Médica Brasileira - 2019. Hematology, Transfusion and Cell Therapy, 41(Supplement 1), 1-73. https://doi.org/10.1016/j.htct.2019.03.001
  23. Umehara, K., Ota, J., & Ishida, T. (2018). Application of super-resolution convolutional neural network for enhancing image resolution in chest CT. Journal of Digital Imaging, 31, 441-450. https://doi.org/10.1007/s10278-017-0033-z
  24. Vannucchi, A. M., & Harrison, C. N. (2017). Emerging treatments for classical myeloproliferative neoplasms. Blood, 129(6), 693-703. https://doi.org/10.1182/blood-2016-10-695965
  25. Vasudevan, S., Saha, A., Tarver, M. E., & Patel, B. (2022). Digital biomarkers: Convergence of digital health technologies and biomarkers. Npj Digital Medicine, 5, Article 36. https://doi.org/10.1038/s41746-022-00583-z
  26. Zhang, H. M., & Dong, B. (2020). A review on deep learning in medical image reconstruction. Journal of the Operations Research Society of China, 8, 311-340. https://doi.org/10.1007/s40305-019-00287-4
  27. Zhang, J., Shao, M., Yu, L., & Li, Y. (2020). Image super-resolution reconstruction based on sparse representation and deep learning. Signal Processing: Image Communication, 87, Article 115925. https://doi.org/10.1016/j.image.2020.115925