Achieving premium pricing for citrus fruits with high-quality is a crucial pathway to enhancing the economic benefits of citrus industry.However，the scientifically and stably comprehensive evaluation of the fruit quality of citrus remains an area requiring a further investigation.Citrus hybrid ‘Ehime Kashi No.28’ known as Hongmeiren or Jelly orange hybrid citrus was used to construct a highly diverse dataset of conventional fruit quality based on 284 sample groups of fruit collected from various production regions over 4 consecutive years.A comprehensive evaluation model with a weighted scoring method combining subjectivity with objectivity was established based on the dataset constructed.The established method was compared with the entropy weight method as an objective evaluation approach and the sensory evaluation as a subjective evaluation approach.The results of correlation analysis under the comprehensive evaluation of fruit quality with the large-sample and multi-batch dataset showed that there was a highly significant correlation （r=0.923） between the weighted scoring method and the entropy weight method，but the correlation between the sensory evaluation and the two quantitative methods was relatively low.The accuracy of the weighted scoring method for comprehensively evaluating the fruit quality was validated by comparing and analyzing the main indexes of quality.The 3 methods had a high degree of consistency under the controlled conditions with the small-sample and single-batch dataset.It is indicated that the diversity of the dataset of fruit quality with multi-year and multi-origin established is high.The weighted scoring method has a good consistency of evaluation and applicability across different batches and sample sizes，with the potential for the cross-year and cross-regional comparisons.Studies in the future should further validate its robustness and stability with additionally independent datasets，particularly through independent validation across multiple years.It will provide a useful reference for comprehensively evaluating and grading the fruit quality of citrus.