万兆网卡 RX DROP 率近 33% 求帮忙分析:

2016-05-26 17:22:33 +08:00
 yuedingwangji

昨天发了个主题 http://v2ex.com/t/281204 ,谢谢 v 友的帮助,按照提示,重新更新了驱动,调整了队列,今天 google 了很多, 还把 rx ring buffer 的缓冲区调大到最大了! 但是今天看了好像丢包还是很严重,算了一下, 丢包率有 33 ,感觉没有什么变化,求大神指点,帮忙分析分析,下面贴出网卡的信息! ####目前最新的驱动: [root@CAIJI ~]# ethtool -i p2p1 driver: ixgbe version: 4.3.15 firmware-version: 0x2b2c0001, 255.65535.255 bus-info: 0000:43:00.0 supports-statistics: yes supports-test: yes supports-eeprom-access: yes supports-register-dump: yes supports-priv-flags: no ####网卡信息 root@CAIJI ~]# ifconfig p2p1 p2p1 Link encap:Ethernet HWaddr 00:16:31:F6:00:F4
inet6 addr: fe80::216:31ff:fef6:f4/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1 RX packets:17199319458 errors:0 dropped:5375941950 overruns:0 frame:0 TX packets:83 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:3000 RX bytes:5909371626285 (5.3 TiB) TX bytes:20466 (19.9 KiB)

最后一个很长, 看不懂

##网卡统计信息 root@CAIJI ~]# ethtool -S p2p1 NIC statistics: rx_packets: 17029710081 tx_packets: 83 rx_bytes: 5852566332178 tx_bytes: 20466 rx_errors: 0 tx_errors: 0 rx_dropped: 0 tx_dropped: 0 multicast: 0 collisions: 0 rx_over_errors: 0 rx_crc_errors: 0 rx_frame_errors: 0 rx_fifo_errors: 0 rx_missed_errors: 5319065929 tx_aborted_errors: 0 tx_carrier_errors: 0 tx_fifo_errors: 0 tx_heartbeat_errors: 0 rx_pkts_nic: 17027492035 tx_pkts_nic: 83 rx_bytes_nic: 7894510228645 tx_bytes_nic: 20798 lsc_int: 12 tx_busy: 0 non_eop_descs: 0 broadcast: 0 rx_no_buffer_count: 0 tx_timeout_count: 0 tx_restart_queue: 0 rx_long_length_errors: 0 rx_short_length_errors: 0 tx_flow_control_xon: 553080 rx_flow_control_xon: 0 tx_flow_control_xoff: 8405544 rx_flow_control_xoff: 0 rx_csum_offload_errors: 42680 alloc_rx_page_failed: 0 alloc_rx_buff_failed: 0 lro_aggregated: 0 lro_flushed: 0 rx_no_dma_resources: 0 hw_rsc_aggregated: 0 hw_rsc_flushed: 0 fdir_match: 0 fdir_miss: 17404483615 fdir_overflow: 0 fcoe_bad_fccrc: 0 fcoe_last_errors: 0 rx_fcoe_dropped: 0 rx_fcoe_packets: 0 rx_fcoe_dwords: 0 fcoe_noddp: 0 fcoe_noddp_ext_buff: 0 tx_fcoe_packets: 0 tx_fcoe_dwords: 0 os2bmc_rx_by_bmc: 0 os2bmc_tx_by_bmc: 0 os2bmc_tx_by_host: 0 os2bmc_rx_by_host: 0 tx_hwtstamp_timeouts: 0 rx_hwtstamp_cleared: 0 tx_queue_0_packets: 6 tx_queue_0_bytes: 2052 tx_queue_1_packets: 0 tx_queue_1_bytes: 0 tx_queue_2_packets: 0 tx_queue_2_bytes: 0 tx_queue_3_packets: 0 tx_queue_3_bytes: 0 tx_queue_4_packets: 15 tx_queue_4_bytes: 5130 tx_queue_5_packets: 0 tx_queue_5_bytes: 0 tx_queue_6_packets: 6 tx_queue_6_bytes: 2052 tx_queue_7_packets: 7 tx_queue_7_bytes: 2394 tx_queue_8_packets: 0 tx_queue_8_bytes: 0 tx_queue_9_packets: 0 tx_queue_9_bytes: 0 tx_queue_10_packets: 0 tx_queue_10_bytes: 0 tx_queue_11_packets: 0 tx_queue_11_bytes: 0 tx_queue_12_packets: 5 tx_queue_12_bytes: 1710 tx_queue_13_packets: 0 tx_queue_13_bytes: 0 tx_queue_14_packets: 6 tx_queue_14_bytes: 2052 tx_queue_15_packets: 4 tx_queue_15_bytes: 1368 tx_queue_16_packets: 0 tx_queue_16_bytes: 0 tx_queue_17_packets: 0 tx_queue_17_bytes: 0 tx_queue_18_packets: 0 tx_queue_18_bytes: 0 tx_queue_19_packets: 0 tx_queue_19_bytes: 0 tx_queue_20_packets: 0 tx_queue_20_bytes: 0 tx_queue_21_packets: 0 tx_queue_21_bytes: 0 tx_queue_22_packets: 0 tx_queue_22_bytes: 0 tx_queue_23_packets: 0 tx_queue_23_bytes: 0 tx_queue_24_packets: 0 tx_queue_24_bytes: 0 tx_queue_25_packets: 0 tx_queue_25_bytes: 0 tx_queue_26_packets: 0 tx_queue_26_bytes: 0 tx_queue_27_packets: 0 tx_queue_27_bytes: 0 tx_queue_28_packets: 0 tx_queue_28_bytes: 0 tx_queue_29_packets: 0 tx_queue_29_bytes: 0 tx_queue_30_packets: 0 tx_queue_30_bytes: 0 tx_queue_31_packets: 0 tx_queue_31_bytes: 0 tx_queue_32_packets: 0 tx_queue_32_bytes: 0 tx_queue_33_packets: 0 tx_queue_33_bytes: 0 tx_queue_34_packets: 0 tx_queue_34_bytes: 0 tx_queue_35_packets: 0 tx_queue_35_bytes: 0 tx_queue_36_packets: 12 tx_queue_36_bytes: 936 tx_queue_37_packets: 0 tx_queue_37_bytes: 0 tx_queue_38_packets: 6 tx_queue_38_bytes: 468 tx_queue_39_packets: 10 tx_queue_39_bytes: 1836 tx_queue_40_packets: 0 tx_queue_40_bytes: 0 tx_queue_41_packets: 0 tx_queue_41_bytes: 0 tx_queue_42_packets: 0 tx_queue_42_bytes: 0 tx_queue_43_packets: 0 tx_queue_43_bytes: 0 tx_queue_44_packets: 0 tx_queue_44_bytes: 0 tx_queue_45_packets: 6 tx_queue_45_bytes: 468 tx_queue_46_packets: 0 tx_queue_46_bytes: 0 tx_queue_47_packets: 0 tx_queue_47_bytes: 0 tx_queue_48_packets: 0 tx_queue_48_bytes: 0 tx_queue_49_packets: 0 tx_queue_49_bytes: 0 tx_queue_50_packets: 0 tx_queue_50_bytes: 0 tx_queue_51_packets: 0 tx_queue_51_bytes: 0 tx_queue_52_packets: 0 tx_queue_52_bytes: 0 tx_queue_53_packets: 0 tx_queue_53_bytes: 0 tx_queue_54_packets: 0 tx_queue_54_bytes: 0 tx_queue_55_packets: 0 tx_queue_55_bytes: 0 tx_queue_56_packets: 0 tx_queue_56_bytes: 0 tx_queue_57_packets: 0 tx_queue_57_bytes: 0 tx_queue_58_packets: 0 tx_queue_58_bytes: 0 tx_queue_59_packets: 0 tx_queue_59_bytes: 0 tx_queue_60_packets: 0 tx_queue_60_bytes: 0 tx_queue_61_packets: 0 tx_queue_61_bytes: 0 tx_queue_62_packets: 0 tx_queue_62_bytes: 0 tx_queue_63_packets: 0 tx_queue_63_bytes: 0 tx_queue_64_packets: 0 tx_queue_64_bytes: 0 tx_queue_65_packets: 0 tx_queue_65_bytes: 0 tx_queue_66_packets: 0 tx_queue_66_bytes: 0 tx_queue_67_packets: 0 tx_queue_67_bytes: 0 tx_queue_68_packets: 0 tx_queue_68_bytes: 0 tx_queue_69_packets: 0 tx_queue_69_bytes: 0 tx_queue_70_packets: 0 tx_queue_70_bytes: 0 rx_queue_0_packets: 1067946600 rx_queue_0_bytes: 371301786109 rx_queue_1_packets: 1061034462 rx_queue_1_bytes: 358712868901 rx_queue_2_packets: 1062751875 rx_queue_2_bytes: 365449065361 rx_queue_3_packets: 1055073987 rx_queue_3_bytes: 363927816936 rx_queue_4_packets: 1074608685 rx_queue_4_bytes: 366905950875 rx_queue_5_packets: 1066423484 rx_queue_5_bytes: 363329617576 rx_queue_6_packets: 1060550322 rx_queue_6_bytes: 365891956546 rx_queue_7_packets: 1068063494 rx_queue_7_bytes: 363372252208 rx_queue_8_packets: 1067095208 rx_queue_8_bytes: 367530097930 rx_queue_9_packets: 1061952300 rx_queue_9_bytes: 361989443609 rx_queue_10_packets: 1059287377 rx_queue_10_bytes: 361914107474 rx_queue_11_packets: 1062221260 rx_queue_11_bytes: 370078112692 rx_queue_12_packets: 1061248369 rx_queue_12_bytes: 367898254977 rx_queue_13_packets: 1062558031 rx_queue_13_bytes: 365364492171 rx_queue_14_packets: 1072149893 rx_queue_14_bytes: 374050936073 rx_queue_15_packets: 1066744879 rx_queue_15_bytes: 364849660661 rx_queue_16_packets: 0 rx_queue_16_bytes: 0 rx_queue_17_packets: 0 rx_queue_17_bytes: 0 rx_queue_18_packets: 0 rx_queue_18_bytes: 0 rx_queue_19_packets: 0 rx_queue_19_bytes: 0 rx_queue_20_packets: 0 rx_queue_20_bytes: 0 rx_queue_21_packets: 0 rx_queue_21_bytes: 0 rx_queue_22_packets: 0 rx_queue_22_bytes: 0 rx_queue_23_packets: 0 rx_queue_23_bytes: 0 rx_queue_24_packets: 0 rx_queue_24_bytes: 0 rx_queue_25_packets: 0 rx_queue_25_bytes: 0 rx_queue_26_packets: 0 rx_queue_26_bytes: 0 rx_queue_27_packets: 0 rx_queue_27_bytes: 0 rx_queue_28_packets: 0 rx_queue_28_bytes: 0 rx_queue_29_packets: 0 rx_queue_29_bytes: 0 rx_queue_30_packets: 0 rx_queue_30_bytes: 0 rx_queue_31_packets: 0 rx_queue_31_bytes: 0 rx_queue_32_packets: 0 rx_queue_32_bytes: 0 rx_queue_33_packets: 0 rx_queue_33_bytes: 0 rx_queue_34_packets: 0 rx_queue_34_bytes: 0 rx_queue_35_packets: 0 rx_queue_35_bytes: 0 rx_queue_36_packets: 0 rx_queue_36_bytes: 0 rx_queue_37_packets: 0 rx_queue_37_bytes: 0 rx_queue_38_packets: 0 rx_queue_38_bytes: 0 rx_queue_39_packets: 0 rx_queue_39_bytes: 0 rx_queue_40_packets: 0 rx_queue_40_bytes: 0 rx_queue_41_packets: 0 rx_queue_41_bytes: 0 rx_queue_42_packets: 0 rx_queue_42_bytes: 0 rx_queue_43_packets: 0 rx_queue_43_bytes: 0 rx_queue_44_packets: 0 rx_queue_44_bytes: 0 rx_queue_45_packets: 0 rx_queue_45_bytes: 0 rx_queue_46_packets: 0 rx_queue_46_bytes: 0 rx_queue_47_packets: 0 rx_queue_47_bytes: 0 rx_queue_48_packets: 0 rx_queue_48_bytes: 0 rx_queue_49_packets: 0 rx_queue_49_bytes: 0 rx_queue_50_packets: 0 rx_queue_50_bytes: 0 rx_queue_51_packets: 0 rx_queue_51_bytes: 0 rx_queue_52_packets: 0 rx_queue_52_bytes: 0 rx_queue_53_packets: 0 rx_queue_53_bytes: 0 rx_queue_54_packets: 0 rx_queue_54_bytes: 0 rx_queue_55_packets: 0 rx_queue_55_bytes: 0 rx_queue_56_packets: 0 rx_queue_56_bytes: 0 rx_queue_57_packets: 0 rx_queue_57_bytes: 0 rx_queue_58_packets: 0 rx_queue_58_bytes: 0 rx_queue_59_packets: 0 rx_queue_59_bytes: 0 rx_queue_60_packets: 0 rx_queue_60_bytes: 0 rx_queue_61_packets: 0 rx_queue_61_bytes: 0 rx_queue_62_packets: 0 rx_queue_62_bytes: 0 rx_queue_63_packets: 0 rx_queue_63_bytes: 0 rx_queue_64_packets: 0 rx_queue_64_bytes: 0 rx_queue_65_packets: 0 rx_queue_65_bytes: 0 rx_queue_66_packets: 0 rx_queue_66_bytes: 0 rx_queue_67_packets: 0 rx_queue_67_bytes: 0 rx_queue_68_packets: 0 rx_queue_68_bytes: 0 rx_queue_69_packets: 0 rx_queue_69_bytes: 0 rx_queue_70_packets: 0 rx_queue_70_bytes: 0 tx_pb_0_pxon: 0 tx_pb_0_pxoff: 0 tx_pb_1_pxon: 0 tx_pb_1_pxoff: 0 tx_pb_2_pxon: 0 tx_pb_2_pxoff: 0 tx_pb_3_pxon: 0 tx_pb_3_pxoff: 0 tx_pb_4_pxon: 0 tx_pb_4_pxoff: 0 tx_pb_5_pxon: 0 tx_pb_5_pxoff: 0 tx_pb_6_pxon: 0 tx_pb_6_pxoff: 0 tx_pb_7_pxon: 0 tx_pb_7_pxoff: 0 rx_pb_0_pxon: 0 rx_pb_0_pxoff: 0 rx_pb_1_pxon: 0 rx_pb_1_pxoff: 0 rx_pb_2_pxon: 0 rx_pb_2_pxoff: 0 rx_pb_3_pxon: 0 rx_pb_3_pxoff: 0 rx_pb_4_pxon: 0 rx_pb_4_pxoff: 0 rx_pb_5_pxon: 0 rx_pb_5_pxoff: 0 rx_pb_6_pxon: 0 rx_pb_6_pxoff: 0 rx_pb_7_pxon: 0 rx_pb_7_pxoff: 0

14911 次点击
所在节点    DevOps
33 条回复
yuedingwangji
2016-05-27 17:02:41 +08:00
@redsonic 十分感谢,已经发 teamview ID 和 密码给你邮件了
yuedingwangji
2016-05-27 17:03:03 +08:00
@jsfaint 请问 DPDK 是什么 ?
yuedingwangji
2016-05-27 17:03:58 +08:00
@menory 我一直觉得都是光模块的问题,可是找不出证据,官模块是另外采购的,谁去采购的都不知道,连型号现在都没弄到 哎
wbw007
2016-05-27 17:29:26 +08:00
呵呵, 82599 必须用英特尔的光模块才行,以前也遇到过你的问题,被坑惨了
yuedingwangji
2016-05-28 00:14:00 +08:00
@wbw007 嗯 , 今天 好心得一位 V 友远程帮我看了, 结构发现网卡是山寨的 , 哎 ,无语了 , 现在已经叫同事去找厂家了
yuedingwangji
2016-05-28 00:15:58 +08:00
在此一并谢过所有回帖的人! 现在初步得出结论 : 网卡是山寨卡, 模块也不是原装的,估计就是这 2 个货惹得货了
jsfaint
2016-05-31 09:15:39 +08:00
@yuedingwangji http://www.dpdk.org/
Intel 82599 64bytes 包 单网口收发可以 tx 10Gbps rx 10Gbps ,同一颗芯片双 port 收发可以 tx 10Gbps rx 7.xGbps
yuedingwangji
2016-05-31 22:48:02 +08:00
@jsfaint 同一颗芯片 双端口 是什么意思?
jsfaint
2016-06-01 17:15:59 +08:00
@yuedingwangji Intel 82599 芯片,一颗芯片可以提供最多两个 10G 网口
yuedingwangji
2016-06-01 21:12:54 +08:00
@jsfaint 嗯 我们那个网卡就有 2 个口 一个 p2p1 一个 p2p1
shidifen
2016-09-20 18:57:58 +08:00
@redsonic ,我有一个类似的问题,请教一下,大神帮忙。
shidifen
2016-09-22 10:57:03 +08:00
@yuedingwangji 我也有一个类似的问题,地址是 https://www.v2ex.com/t/307630#reply13 ,能帮忙给看不?我很想知道:最后如何识别是寨卡的,能留个 qq 不,我也是给移动做项目的。
huyang
2017-04-02 15:14:34 +08:00
你这个最后怎么 解决的 ,我现在 也遇到了这样的 问题,产生这个问题的原因是什么

这是一个专为移动设备优化的页面(即为了让你能够在 Google 搜索结果里秒开这个页面),如果你希望参与 V2EX 社区的讨论,你可以继续到 V2EX 上打开本讨论主题的完整版本。

https://www.v2ex.com/t/281482

V2EX 是创意工作者们的社区,是一个分享自己正在做的有趣事物、交流想法,可以遇见新朋友甚至新机会的地方。

V2EX is a community of developers, designers and creative people.

© 2021 V2EX