Performance Analysis of Big Model Transmission under Double Rayleigh Fading: Performance Analysis of Big Model Transmission

Ying Sun; Jiajia Huang; Fusheng Wei

doi:10.4108/eetsis.3776

Authors

Ying Sun Guangdong Power Grid Co.
Jiajia Huang Guangdong Power Grid Co.
Fusheng Wei Guangdong Power Grid Co.

DOI:

https://doi.org/10.4108/eetsis.3776

Keywords:

Big model, data transmission, double Rayleigh fading, performance analysis

Abstract

The recent big model such as GPT-3.5 possesses an extensive understanding of natural language, and it can perform a wide range of tasks, making it a significant advancement in the field of artificial intelligence (AI). A critical challenge in the design and implementation of big model is that it imposes a heavy load on the wireless transmission due to a huge size of the network parameters, especially for the distributed implementation. To tackle this challenge, we investigate big model transmission under practical double Rayleigh fading environments, where the big model is simultaneously distributed to multiple training nodes. To evaluate the system performance, we study the system outage probability (OP) based on the transmission latency, where an analytical expression is derived for the OP. Finally, we present some simulations under double Rayleigh fading environments, in order to show the validity of the proposed big model transmission.

References

D. Chandra, P. Botsinis, D. Alanis, Z. Babar, S. X. Ng, and L. Hanzo, “On the road to quantum communications,” Infocommunications Journal, vol. 14, no. 3, pp. 2–8, 2022.

Z. Huang, L. Bai, X. Cheng, X. Yin, P. E. Mogensen, and X. Cai, “A non-stationary 6g V2V channel model with continuously arbitrary trajectory,” IEEE Trans. Veh. Technol., vol. 72, no. 1, pp. 4–19, 2023.

A. E. Haddad and L. Najafizadeh, “The discriminative discrete basis problem: Definitions, algorithms, benchmarking, and application to brain’s functional dynamics,” IEEE Trans. Signal Process., vol. 71, pp. 1–16, 2023.

S. S. Mahdi and A. A. Abdullah, “Enhanced security of software-defined network and network slice through hybrid quantum key distribution protocol,” Infocommunications Journal, 2022.

Z. Xie, W. Chen, and H. V. Poor, “A unified framework for pushing in two-tier heterogeneous networks with mmwave hotspots,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 19–31, 2023.

Y. Fang, “-ary distributed arithmetic coding for uniform -ary sources,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 47–74, 2023.

T. Häckel, P. Meyer, F. Korf, and T. C. Schmidt, “Secure time-sensitive software-defined networking in vehicles,” IEEE Trans. Veh. Technol., vol. 72, no. 1, pp. 35–51, 2023.

Y. Song, Z. Gong, Y. Chen, and C. Li, “Tensorbased sparse bayesian learning with intra-dimension correlation,” IEEE Trans. Signal Process., vol. 71, pp. 31– 46, 2023.

H. Wan and A. Nosratinia, “Short-block length polarcoded modulation for the relay channel,” IEEE Trans. Commun., vol. 71, no. 1, pp. 26–39, 2023.

Q. Lu, S. Li, B. Bai, and J. Yuan, “Spatially-coupled fasterthan-nyquist signaling: A joint solution to detection and code design,” IEEE Trans. Commun., vol. 71, no. 1, pp. 52–66, 2023.

B. Han, V. Sciancalepore, Y. Xu, D. Feng, and H. D. Schotten, “Impatient queuing for intelligent task offloading in multiaccess edge computing,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 59–72, 2023.

H. Hou, Y. S. Han, P. P. C. Lee, Y. Wu, G. Han, and M. Blaum, “A generalization of array codes with local properties and efficient encoding/decoding,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 107–125, 2023.

Y. Xiong, S. Sun, L. Liu, Z. Zhang, and N. Wei, “Performance analysis and bit allocation of cell-free massive MIMO network with variable-resolution adcs,” IEEE Trans. Commun., vol. 71, no. 1, pp. 67–82, 2023.

J. Shao, Y. Mao, and J. Zhang, “Task-oriented communication for multidevice cooperative edge inference,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 73–87, 2023.

H. H. López and G. L. Matthews, “Multivariate goppa codes,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 126–137, 2023.

Y. Sun, D. Wu, X. S. Fang, and J. Ren, “On-glass grid structure and its application in highly-transparent antenna for internet of vehicles,” IEEE Trans. Veh. Technol., vol. 72, no. 1, pp. 93–101, 2023.

P. Tichavský, O. Straka, and J. Duník, “Grid-based bayesian filters with functional decomposition of transient density,” IEEE Trans. Signal Process., vol. 71, pp. 92–104, 2023.

C. Zeng, J. Wang, C. Ding, M. Lin, and J. Wang, “MIMO unmanned surface vessels enabled maritime wireless network coexisting with satellite network: Beamforming and trajectory design,” IEEE Trans. Commun., vol. 71, no. 1, pp. 83–100, 2023.

Q. Li, R. Gan, J. Liang, and S. J. Godsill, “An adaptive and scalable multi-object tracker based on the non-homogeneous poisson process,” IEEE Trans. Signal Process., vol. 71, pp. 105–120, 2023.

F. Hu, Y. Deng, and A. H. Aghvami, “Scalable multiagent reinforcement learning for dynamic coordinated multipoint clustering,” IEEE Trans. Commun., vol. 71, no. 1, pp. 101–114, 2023.

H. Hui and W. Chen, “Joint scheduling of proactive pushing and on-demand transmission over shared spectrum for profit maximization,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 107–121, 2023.

W. Yu, Y. Xi, X. Wei, and G. Ge, “Balanced set codes with small intersections,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 147–156, 2023.

J. Sun, J. Yang, G. Gui, and H. Sari, “In-motion alignment method of SINS under the geographic latitude uncertainty,” IEEE Trans. Veh. Technol., vol. 72, no. 1, pp. 125–135, 2023.

Z. Zhang, Z. Shi, and Y. Gu, “Ziv-zakai bound for doas estimation,” IEEE Trans. Signal Process., vol. 71, pp. 136– 149, 2023.

S. Guo and X. Zhao, “Multi-agent deep reinforcement learning based transmission latency minimization for delay-sensitive cognitive satellite-uav networks,” IEEE Trans. Commun., vol. 71, no. 1, pp. 131–144, 2023.

X. Fang, W. Feng, Y. Wang, Y. Chen, N. Ge, Z. Ding, and H. Zhu, “Noma-based hybrid satellite-uav-terrestrial networks for 6g maritime coverage,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 138–152, 2023.

R. Gabrys, V. Guruswami, J. L. Ribeiro, and K. Wu, “Beyond single-deletion correcting codes: Substitutions and transpositions,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 169–186, 2023.

E.-s. Azougaghe, A. Farchane, S. Safi, and M. Belkasmi, “Turbo decoding of concatenated codes based on rs codes using adapted scaling factors,” Infocommunications Journal, vol. 14, no. 1, pp. 11–16, 2022.

Y. Liu, Z. Tan, A. W. H. Khong, and H. Liu, “An iterative implementation-based approach for joint source localization and association under multipath propagation environments,” IEEE Trans. Signal Process., vol. 71, pp. 121–135, 2023.

K. Ma, S. Du, H. Zou, W. Tian, Z. Wang, and S. Chen, “Deep learning assisted mmwave beam prediction for heterogeneous networks: A dual-band fusion approach,” IEEE Trans. Commun., vol. 71, no. 1, pp. 115–130, 2023.

B. Banerjee, R. C. Elliott, W. A. Krzymien, and H. Farmanbar, “Downlink channel estimation for FDD massive MIMO using conditional generative adversarial networks,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 122–137, 2023.

S. Liu and L. Ji, “Double multilevel constructions for constant dimension codes,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 157–168, 2023.

I. S. Gradshteyn and I. M. Ryzhik, Table of Integrals, Series, and Products, 7th ed. San Diego, CA: Academic, 2007.

X. Chen, W. Wei, Q. Yan, N. Yang, and J. Huang, “Timedelay deep q-network based retarder torque tracking control framework for heavy-duty vehicles,” IEEE Trans. Veh. Technol., vol. 72, no. 1, pp. 149–161, 2023.

Z. Yang, F. Li, and D. Zhang, “A joint model extraction and data detection framework for IRS-NOMA system,” IEEE Trans. Signal Process., vol. 71, pp. 164–177, 2023.

T. Zhang, K. Zhu, S. Zheng, D. Niyato, and N. C. Luong, “Trajectory design and power control for joint radar and communication enabledmulti-uav cooperative detection systems,” IEEE Trans. Commun., vol. 71, no. 1, pp. 158– 172, 2023.

M. Zaher, Ö. T. Demir, E. Björnson, and M. Petrova, “Learning-based downlink power allocation in cell-free massive MIMO systems,” IEEE Trans. Wirel. Commun., vol. 22, no. 1, pp. 174–188, 2023.

M. Salman and M. K. Varanasi, “The -user DM broadcast channel with two groupcast messages: Achievable rate regions and the combination network as a case study,” IEEE Trans. Inf. Theory, vol. 69, no. 1, pp. 194–222, 2023.

H. Farran, D. Khoury, and L. Bokor, “A comprehensive survey on the application of blockchain/hash chain technologies in v2x communications,” Infocommunications Journal, vol. 14, no. 1, pp. 24–35, 2022.