|
|
<p style="white-space: normal;text-align: center;"><span style="color: rgb(0, 209, 0);">Zebra项目知识介绍共五篇（四）——</span><br /></p><p style="white-space: normal;text-align: center;"><span style="color: rgb(0, 209, 0);"><span style="color: rgb(0, 209, 0);text-align: center;">Zebra项目介绍</span></span></p><p style="white-space: normal;"><span style="color: rgb(0, 209, 0);"></span></p><p style="white-space: normal;">===========================================================</p><p style="white-space: normal;"><strong>一、Zebra</strong></p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>有多台一级引擎，每个一级引擎负责一部分数据，每个一级引擎对自己负责的那部分数据进行处理，统一发往二级引擎进行汇总的操作，最终二级引擎将数据存储到关系型数据库中。<span class="Apple-tab-span" style="white-space: pre;"> </span></p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>Engin1分析:</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>扫描指定的文件夹获取要处理的数据文件，解析出自己所要处理的部分。</p><p style="white-space: normal;"> 切出这部分要处理的内容，加载到内存中，进行切行的操作，获取出自己要处理的行。</p><p style="white-space: normal;"> 将每一行都转换为业务对象，进行业务的处理。</p><p style="white-space: normal;"> 将数据发送给二级引擎。<br /></p><p style="white-space: normal;"><br /></p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>Engin2分析：</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>接收一级引擎发送的数据<span class="Apple-tab-span" style="white-space: pre;"> </span>。<span class="Apple-tab-span" style="white-space: pre;"> </span></p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>将收到的数据进行合并操作。<span class="Apple-tab-span" style="white-space: pre;"> </span></p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>将数据持久化到数据库中。</p><p style="white-space: normal;"><br /></p><p style="white-space: normal;"><strong style="white-space: normal;">二、Zebra项目过程分析</strong></p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>1.写proto文件，描述bean</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>2.准备数据文件</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>3.写程序处理文件</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>4.数据处理</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>数据进行处理 -- 一级引擎</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>数据进行分组 -- 二级引擎</p><p style="white-space: normal;"><span class="Apple-tab-span" style="white-space: pre;"> </span>同组数据进行累加 -- 二级引擎</p><p style="white-space: normal;">===========================================================</p><p style="white-space: normal;text-align: center;"><span style="color: rgb(255, 79, 121);">整个Zebra项目知识总结</span></p><p>①了解NIO 的原理、代码</p><p>②Concurrent包 重要工具 —— BlockingQueue、CountDownLantch、③ExcutorService、Lock、ConcurrentHashMap</p><p>④知道常见序列化框架 掌握RPC 理论部分</p><p>⑤zookeeper的全部： 安装配置 理论原理 shell操作 java操作 常用功能</p><p>⑥明白zebra的业务需求</p><p>⑦了解分布式处理的思想</p><p>⑧zebra代码熟悉即可，不需要自己写</p><p><br /></p><p><span style="color: rgb(255, 79, 121);"><strong><span style="font-size: 20px;">Zebra项目知识介绍共五篇（五）将分析Zebra源码，敬请期待！！<img src="https://res.wx.qq.com/mpres/htmledition/images/icon/common/emotion_panel/smiley/smiley_76.png" data-ratio="1" data-w="20" style="display:inline-block;width:20px;vertical-align:text-bottom;" /><img src="https://res.wx.qq.com/mpres/htmledition/images/icon/common/emotion_panel/smiley/smiley_76.png" data-ratio="1" data-w="20" style="display:inline-block;width:20px;vertical-align:text-bottom;" /><img src="https://res.wx.qq.com/mpres/htmledition/images/icon/common/emotion_panel/smiley/smiley_76.png" data-ratio="1" data-w="20" style="display:inline-block;width:20px;vertical-align:text-bottom;" /></span></strong></span></p><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><hr style="font-size: 16px;white-space: normal;max-width: 100%;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;" /><p style="font-size: 16px;white-space: normal;max-width: 100%;min-height: 1em;color: rgb(62, 62, 62);background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;"><span style="max-width: 100%;line-height: 25.6px;color: rgb(0, 128, 255);box-sizing: border-box !important;word-wrap: break-word !important;">请扫描下面二维码，关注该微信公众号，获取更多</span><span style="max-width: 100%;line-height: 25.6px;color: rgb(255, 41, 65);box-sizing: border-box !important;word-wrap: break-word !important;"><strong style="max-width: 100%;box-sizing: border-box !important;word-wrap: break-word !important;">生物医学工程</strong>专业及<strong style="max-width: 100%;box-sizing: border-box !important;word-wrap: break-word !important;">医工</strong><span style="max-width: 100%;line-height: 25.6px;color: rgb(0, 128, 255);box-sizing: border-box !important;word-wrap: break-word !important;">学习笔记</span>：</span><span style="max-width: 100%;color: rgb(0, 0, 0);box-sizing: border-box !important;word-wrap: break-word !important;"></span></p><p style="font-size: 16px;white-space: normal;max-width: 100%;min-height: 1em;color: rgb(62, 62, 62);line-height: 25.6px;background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;"><span style="max-width: 100%;line-height: 25.6px;color: rgb(255, 41, 65);box-sizing: border-box !important;word-wrap: break-word !important;"></span></p><p style="font-size: 16px;white-space: normal;max-width: 100%;min-height: 1em;color: rgb(62, 62, 62);line-height: 25.6px;text-align: center;background-color: rgb(255, 255, 255);box-sizing: border-box !important;word-wrap: break-word !important;"><img class="" data-ratio="1" data-s="300,640" src="http://mmbiz.qpic.cn/mmbiz_jpg/LKgI6UN8ElZnh0jXF3PjbBz7BBPnYH7wbDgfc3E2r7REMuN2lQqfuVM38HZO8Zx0rN0OLKywrjoH3P7QqDY44Q/640?wx_fmt=jpeg" data-type="jpeg" data-w="430" width="auto" style="box-sizing: border-box !important;word-wrap: break-word !important;visibility: visible !important;width: auto !important;" /></p><p><br /></p>
|
|
发表于 2020-10-20 11:42:39