This thing is very interesting. What's scary is it's almost like mikrotik read my mind. Always thought you could fit a router board on a PCI card. But they went above this and use sfp28 interfaces? Insane

I asked for this years ago on the forums and was told there was no viable use case for it. Glad to see it finally came to fruition. Already purchased one and have it running in the data center as a management gateway device. It's great as an add-on card to a dedicated management server.

You guys think out-of-the-box!!! I love it!

This is fantastic for any software defined infrastructure deployment. I'm more interested in the lab implications though... anyone who's ever virtualized pfsense and dealt with the issues that can arise there has probably had the same thought I've had - "it can't be that difficult to pre-boot a single VM"... well, now it isnt.

Now I really can't wait for Raspberry Pi to release the Pi 5 Compute Module with PCIe 3.0 and some decent storage interfaces! Combined with this card, it will be the perfect all-in-one home server!

As an ISP, I can really see the value of this product. My hands are itching for this. Stock is an issue though. Kudos Mikrotik on really thinking outside the box here

If this can perform VXLAN + Bridging or VPLS + Bridging in FastPath and RouterOS added eVPN support this card could be used to create a Data Centre fabric between Hypervisor (VM) servers

@Andrew_Thrift

2 жыл бұрын

Combined with CRS3xx switches that have L3HW forwarding it would create a very compelling solution

@consi1990

2 жыл бұрын

EBGP eVPN VXLANs would be game changer combined with that card

@jdl3408

2 жыл бұрын

@@consi1990 True, but doing all then encap/decap without dedicated silicone blocks is going to be slow. I’m assuming the SoC doesn’t have those blocks, if it does any you can set up a path for it, sure.

You guys are crazy and I love it

I love this idea! It is giving me a NVIDIA Bluefield or AMD Pensando vibe, but affordable to us home labbers! I can offload parts of my networking and security functions from the host, into the CCR PCI cards, like firewalling, routing, SDN networks, probably more features that I can't think of on the fly! I will definitely be buying one to test!

nice idea! interesting really! this opens a lot of ideas!

Will there be a SDK for packet processing? Especially, can I run dpdk directly on it?

Which interfaces are available to ROS? Can you share a list of the interfaces? Oh and I almost forget, wow this is an amazing device!!!

I would use this to convert a desktop I am building into into a full-fledged home server/router. It would make possible to to take two leaps: beyond 10GbE and beyond RJ45! In a desktop!!! The implications for a network are quite exciting to say the least. Will this new product line also become available in PCIE 4.0 x4 and 5.0 NICs?

I like it. I just hate the part where the card needs to boot before the server. Would it be possible to make one that boots on standby power like how idrac or ILO works?

Definitely after getting a bunch of them for my startup. How can I do that here in Italy? Thanks!

when Mikrotik accidentally makes a DPU :) As far as what id like to see, id want to see you send this to ServeTheHome and Level1Techs and see what they'd do with it

@mikrotik

2 жыл бұрын

Accidentally?

@prostaknaivnyj5976

2 жыл бұрын

@@mikrotik hell yeah! this is what ppl think bout ur job: just toss some chips on board, sprinkle with smd components to ur taste n then bake it in oven under 250C for 15 mins! et voila!

honestly i would love to test this product in my home

Wonder if Mikrotik can implement PCIe card hot-plugging to avoid having to put a delay in boot up.

Блин, гениальная компания, гениальные изобретения

What NIC chipset/chipsets do the virtual Ethernet ports show up as to the host system?

Thats very awesome! In Switzerland we got thanks to Init7 25Gbit FTTH. What is it priced and when will it be available?

The documentation says that by default, two of the virtual interfaces are pass-through access to the SFP28 cages and the other two virtual interfaces are bridges to the GigE interface. Is it possible to bridge one of the SFP28 cages instead/additionally? The current user manual doesn't make that part clear.

will it be backward compatible with 2.4G and 10G SFPs ? I'm thinking of being able to put GPON and XGS-PON sticks inside this NIC

Can you use the 1xBaseT port as a WAN port instead of management duties? Can you then use the virtual 2x25GbE the host sees as a LACP/LAGG combined 50Gb throughput port to the router, with the physical ports exposed to switches in the rest of the network? That way, you could potentially put it into the server, connect switches through the 25GbE fibre, and connect containers running on the server through the virtual internal ports to the same network, and finally through the Base-T everything would reach to the outside world... but that plan would work only if the management port could be converted to WAN only...

Would such a card continue to run in a typical rack server while the system is rebooting? Can it ignore a PCIe "reset" signal? Would it run when the system is in standby state? (i.e. "powered off" but DRAC or ILO still alive and waiting for powerup action by remote admin)

@aseimel

Жыл бұрын

I'd really be interested to know this too

Does anyone have a compelling use case for something like this? I've thought about what I could/would do and everything seems to come back to 'well, you could just use a 25GbE NIC'.

Seems perfect for SAN and Visualizers. Also my colleague asks if there is going to be 4G LTE, 5G variant with external antennas in same form factor :D

Add at least one or two of most popular software features of a DPU (like Fungible, nVidia) and this will sell out, fast. I think a huge one would be NVMe over network. With DPU you can make such that a card shows up as normal NMVe drive to host PC, but actually all data is streamed over network. With 50Gbps there would be no bandwidth penalty.

@polonkaig

2 жыл бұрын

You mean NVMeoF? Kioxia is doing this: kzread.info/dash/bejne/kZ2bx8tudrnLlaQ.html

What happens when just the Router (on a card) needs restarted (power cycle) but not the host server itself? Is there a reboot button on the card? It would be a shame to have to restart the entire server (running VM's/etc) because the routerboard card needs a restart.

On cool. But what about pricing and where can I buy them?

Could you use this card instead of the original Synology NICs with PCIe 3.0 x8? It would be usefull in my usecase when I could use this one with one SFP and the Ethernet-Port for routing and the other NIC for my file transfers and stuff...

you're sying it works on 2U but would it work on 1U systems like HPE DL360 ?

this is very cool but could i put my own router OS on there? I have a Vmware Esxi server that serves as my router/firewall "open sense & Debian file server + some other testing i use two vswitch a red and a green the green connects to the real world via quad port 1gb( connects to real world switch) and 10Gb dual port 1 port directly to workstation, so i was thinking using your card with opensense have 25Gb go to switch the other 25Gb directly to my workstation and via your card have connected at full 25Gb to my file server? Thus no overhead of opensense running on the server, i can still connect at 25Gb to my workstation and switch?

what happend if you plug it into pci-e 3.0 x4?

is there some breakout dac cables compatible with sfp28 slots? why you didn't used sfp+ interfaces?

@Packetlust

2 жыл бұрын

There are 25Gbps SFP28 DACs, and this product appears to be compatible with SFP+ optics/DACs as well

Anyone know if you can convert the 25 gig ports into 10 gig rj45 ports?

Will the device thermo throttle If the fan fails?

Nice! How about an enclosure with just the power rails and whatever else bare minimum on the PCIe connector is needed to run this standalone without a host computer? For a compact 2xSFP28 + 1xGigE router ;-)

@Rob2

2 жыл бұрын

Of course then you can buy an existing MikroTik CCR2xxx router. But what would be interesting is having like 8 of these on a bare PCIe motherboard that serves as a backbone only... However you would likely need some chips on that board (PCIe controllers and some management CPU to detect and initialize them)

@AN-jd6om

2 жыл бұрын

I wish there was something that had a couple (two or more) SFP+/SFP28 + maybe a few xGigE copper, in a more compact enclosure than full rackmount (so CCR1009 PC size or smaller), capable of routing several Gbps... To my knowledge there is no such thing (yet).

I'll be using these as routers built in to servers to support site to site vpn for backup replication, and providing server to azure vpn bridges to cut out any reliance on external network routers. At the price they are pitched at, its just as cheap as an external router, but won'rt take up any rack space.

Out of the box. Will check it

Can this card stay running (even with capped performance) powered of just the standby +5V power rail? Can it be used to start the host system (e.g. wake via SSH/HTTPS API over WireGuard or ZeroTier)? Edit (update): It only monitors the +3.3 and +12V power supply under /system/health/print -> I assume it's not using +5V (the only stand by voltage available on common PSUs).

something like this with qualcomm 4g & 5g gsm modem chip ?.

do you have a driver for vmware esxi 6.5? does it work well in virtualized environments? I already use mikrotik CHR with Intel X520 board and active PCI-PASSTHROUGH for chr vm and it works very well! I want to put it on my Dell Poweredge!!

I like the idea

Is it true, you can't have one port at 10G and the other at 25G?

@mikrotik : do you have configuration examples to share, because your online documentation doesn't even mention the passthrough setting under /interface/ethernet and it doesn't work as expect. Putting the SFP28 and PCIe devices on a bridge works, but doesn't come to saturating a 10Gb/s link not to mention 25Gb/s.

Yes! Wonderful! 😁😊😎

Does this card work in a PCIe Mac (e.g. Mac Pro) or is support for MACOS planned?

@mikrotik

2 жыл бұрын

Not planned

Will you plan to set forth a driver for windows? I think many users of RouterOS work under windows environment so activating such NIC under windows would be very practicle and useful.

I think you should make the ethernet switch version for this PCI card.

Use the Microtek 10gb switches. Going to look at this more.

Pretty cool!

Will this be compatible to use in a Windows 2019 Server? I plan on testing it for my incoming Gigabit Wan and create a robust Lan network for the rest of my devices.

@mikrotik

2 жыл бұрын

No, only Linux and BSD drivers

That could be also an answer for some sort to hybrid Software Defined Network using dedicated routing and swiching CPU. What i'm still missing is some management system that could managed the firewall policies and upgrades from single place. If you will add such card to 500 servers you could build underlay network, but without management software it could be hard to manage. This could open a new business where you could build network cloud services and provide it to the hypervisor or server on top of hardware that is added to server. It could compete with cisco or vmware solutions with good management software. At this moment Mikrotik do not have good management software apart from winbox.

Does it work on a raspberry pi?

I think this might make an interesting addition to an old VM host running Avaya Communications Manager and not much else.

So cool!

where are your upstream OpenWRT patch's

Would love to see this with a 2.5G or even 10G ethernet port 😄

Does this support ROCE ?

Congrats MikroTik. Very nice product. I have a doubt. The PCIe slot is only for powering up this card? I have a Proxmox cluster. Proxmox is based on Debian. Can I put it in one of my hosts and then just plug one RJ45 patchcord in it and to my switch or Lan port then I will be able to access the Router OS via Winbox?

@mattmck

Жыл бұрын

i have one running under proxmox 7.2, so yes it is possible

@gabrielporto.mikrotik

Жыл бұрын

@@mattmck Great. But, How many nodes do you have?

@mattmck

Жыл бұрын

I have it installed in 1 of my nodes as an ingress end point.. I disabled the pass through mode on the sfps mapped one as an uplink and the other to internal switch(which all my other nodes are attached to). I then attached a bridge to the internal port and created a bond on the 4 pcie ports and added it to the bridge.

@mattmck

Жыл бұрын

@@gabrielporto.mikrotik I have 5 nodes fyi

Impressive!!!

wild stuff!

Did someone say Mikrotik DPU's? Hell yeah.

video card ?? rsrsr beautiful!

I bought this device today, After pluggin in to my System, it did't boot up. There is no response from this router. How to make it working and detect in System? Also it's not showing in winbox after connecting with lan.

@mikrotik

Жыл бұрын

Please write an email to support@mikrotik.com and we will help

I would have loved to just drop this in my Synology NAS, but my modem is in the wrong room. Maybe next time, though I did just invest in all this 10 GbE gear. 😅

This Ethernet card have a asic processor?

@mikrotik

2 жыл бұрын

This is clearly answered in the video 🤔

🤤Run Container on the PCIe Card!!! Oh, maybe you have already catch up VMware. (they release a fling version that supports Arm, also mention the idea of smart-nic in their docs, running VM on nic, etc, but have not seen any POC,yet.) BTW, you said "mainstream" support, does that include ESXi? And how the NIC show in OS (a mikrotik with proprietary driver or existing chipset brand?), Any SR-IOV Support? Maybe some times in the future we can offload the VM traffic to mikrotik "nic"?

@neggles

2 жыл бұрын

Look up VMWare's Project Monterey - they're already running ESXi on DPUs, specifically nVidia/Mellanox BlueField :)

@tutugreen_dayo

2 жыл бұрын

​@@neggles wow, just checked it, very powerful (also the $$$). mikrotik has a good starting point.

I purchased this card with the idea that it would be a super solution for my hyper-v datacenter where there are a lot of virtual machines and a wide Internet channel. What was my surprise that it was incompatible with windows, because nowhere in the brochures and promotional articles and reviews was there a word about it... Is it really impossible to come up with anything to work in a Windows environment. For me personally, it would just be a super solution... And I do not see any point in sticking this board into a separate Linux machine at all, since the restriction on external ports will lead to the fact that you will have to use computer resources and then the board does not make any sense at all. And so the Internet came - I distributed traffic to virtual machines via internal ports (which are not working now) and there is another 25G port for connecting the switch - this is a masterpiece of engineering. But for some reason, the manufacturer did not finalize this moment.

Oh God, this is ammaizing

1U server colocation, router + server in a 1U form factor so cost savings

Nice :-)

PCie 4?

And for a second I thought: "a video card? But they do networking, how come...? Ooooh, OOOOOOOOOOOOH, oh my whaaaaaat?"

Hi! Good news and nice device.. but how about Windows Servers support?

I want to make a pfsense box and add this card for a 25Gbps connection I can order at my new apartment.

Since it's a CCR2004 does it reboot the host at random with it? lol

@mikrotik

2 жыл бұрын

Upgrade to 7.2 to fix any reboot issues ;)

@MobileMCV

2 жыл бұрын

@@mikrotik 7.2 still reboots unfortunately. I’ve got a ticket open. Fingers crossed the firmware you guys gave me fixes it. :)

Guys! Canwe have a budget model like this with 4 1gbit ports? Even with mipsbe processor, doesnt matter. Just need it to setup firewalled\tunnelled IPMI\iDRAC remotely for server in datacenter. This product is good, but way too powerful for that and SFP cages, not ethernet ports unfortunately. Please make a budget model asap in the same formfactor, even if it'll gonna be map with only 2 ethernet ports (but better 4).

Any windows support?

@mikrotik

2 жыл бұрын

No plans

@mjducharme

2 жыл бұрын

@@mikrotik Windows support could make this a very tempting 25Gbps NIC for home power users. I would love to be able to put one of these in my Windows desktop and get 25Gbps support plus another router out of it.

@randrews4614

2 жыл бұрын

if you open this to windows users ( windows drivers) more people will be looking at this cards as more up take which is a good thing would ask you reconsider this for windows support as server support

I wonder if this unlisted link thing is an attempt on market research. Essentially following the train of word of mouth and how many people it can reach without being public.

@mikrotik

2 жыл бұрын

No, it was only sent to distributors. Wonder which leaked it 😂

@amateurwizard

2 жыл бұрын

@@mikrotik I'm glad they did 🙂. Could upload many and give 1 link per distributor. The one with the views etc.

@ctrlaltbackspace

2 жыл бұрын

Bad bad distributors. @distributors, are there more links? Fee free to comment.

@markchang9776

2 жыл бұрын

@@mikrotik Sorry that this is a leaked information, but I liked the product so much!! saving money...

@Rob2

2 жыл бұрын

@@mikrotik We all know which distributors have products listed in their webshops before they have been announced, don't we?

I swear to God if this is something you could configure into a NAS that just lives inside your main desktop PC with it's own M.2 slots for storage, I would shill this to every single one of my friends forever.

Arm cores, RAM, hardware-accelerated networking, interface pass-through, an entire OS that you can run whatever you want on... ...Almost sounds like the beginning of a DPU to me

@kwinzman

Жыл бұрын

Unfortunately RouterOS does not give you root access so "whatever you want" might be a bit limited. Maybe with containers but that has some limitations.

make one of those with a PCIe switch/bridge, at least Gen3 x16, and add 2 bootable* m.2 sockets - must be low-profile, though - like the startech/qnap/snology(?) card, but more affordable. I don't even need 10gig, 2g5 is fine, 5g is plenty. (gen3x16 because i want full bandwidth on all interfaces - no best-effort switching) (edit: *bootable depends on BIOS/UEFI, of course - i'm sure you could massage it a little) Edit2: my use case is a fairly inexpensive HPE MicroServer Gen10 PLUS (it really struggles with bifurcation) - i can have, either a 10gig card (quite affordable ConnectX3), or i can have my Intel DC P3700 as non-redundant ZFS cache - i'd like to boot my hypervisor (Ubuntu LTS) from mdraid1, use the remaining capacity redundantly (partitions) for ZFS R/W caching, AND have at least one 2G5 ethernet port, that i can pass-through to a (OPNsense/PFsense) VM.

@fluffyfloof9267

2 жыл бұрын

Do you get pinged, when i edit my comment? If not, this shall be your ping - please see thread above.

@mikrotik

2 жыл бұрын

Making a new product takes a very long time. Thanks for the ideas, but if anything new will be made in this form factor - not this year, probably not the next year either

@fluffyfloof9267

2 жыл бұрын

@@mikrotik no worries, i'm aware of development lead times - and as far as i can see, my (HPE-)unofficial 9th gen I3 (9100F) upgrade, is the latest ECC-capable non-Xeon intel CPU. Those 12th gen CPUs don't support ECC MEM, it seems. (not sure whether that internal DDR5-ECC is the same)

@kenzieduckmoo

2 жыл бұрын

curious why youd ask for pcie3 x16 instead of pcie4 x8. if making a new device, why intentionally spec it 2 generations back?

@fluffyfloof9267

2 жыл бұрын

@@kenzieduckmoo because that's my use case - gen 3 is all she's got, captain.

Shame this isn't pci-express 4.0, could have used a lowly 4x config :(

I need Mikrotik Tshirt

Would be nice if it creates 2x 2.5Gb intefaces

@kwinzman

Жыл бұрын

What? Why would it create 2.5Gb interfaces, when it has 25Gb interfaces?

Mikrotik should Develop a single port pci-e 3.0 X16 100G port and a quad-port 10/25G SFP+ pci-e 3.0 x16 also.. so i can run them on my Dell R920 my 4 CPUs E7-8895 2.8Ghz total 60cores/120 threads.... so i can put the CCR2216 to sleep...

Please, please, pleaaaaaaaase put more storage on the card, or at least give us a microSD slot - with future routerOS able to run containers, it would be crazy to kneecap this thing's ability to compete with cards like the BlueField-2 by giving it only 128MiB to work with. Especially considering the very, very low cost of adding extra storage - even upgrading to a 1GiB NAND chip would be a massive improvement. This is my main complaint with the CCR2004-1G-12S+2XS (and to a lesser extent the RB5009, which does at least have a USB3 port, but a flash drive hanging out the front is easy to damage...) The CCR2116 shows you're aware of just how powerful containers can be, and in a DPU-type device like this even moreso - please, please, please don't kneecap it for no reason :(

@BattousaiHBr

2 жыл бұрын

i dont understand the use case of that. sure, containers are cool on a typical CCR because you can avoid having to use additional devices, but this is not the case here, this is already plugged in into an actual server/PC, so what's the advantage of being able to run containers on the card instead of the host system?

@kenzieduckmoo

2 жыл бұрын

@@BattousaiHBr i think its a "because you can" thing, especially when dpu's like bluefield2 also run inside servers

@neggles

2 жыл бұрын

​@@BattousaiHBr the way I see it, this card can essentially replace a firewall VM on a VM host, and would be *awesome* for a server in a shared colo rack. Being able to run a few small containers on it could allow for things like a reverse-proxy (or even apache guacamole) to access the host's IPMI/iDRAC, pi-hole to filter DNS for every VM guest without anything running on the host, running unbound as a general shared recursive resolver, cloudflared to reverse-tunnel via CloudFlare Access, a Smokeping instance, run iperf3 in a container and get bandwidth testing that works cross-platform, run WAN optimization software, an S3 storage proxy service, any number of little web services that might otherwise need a dedicated VM. 4GB of RAM is a bit low for this, sure, and IMO there would be a market for a variant of this with 8GB of RAM, but even with 4GB of RAM, if it had 4GB of eMMC (or an SD slot) there's a lot of useful things you could do.

@neggles

2 жыл бұрын

@@kenzieduckmoo also yeah you're right i'm pretty much looking at this as the poor man's BlueField-2, and I mean... it's not *not* that...

@BattousaiHBr

2 жыл бұрын

@@neggles no... but if it's running on a server, why not just run the container on the server?

If I could only convince my boss to dump Cisco...

@prostaknaivnyj5976

2 жыл бұрын

dump ur boss for mikrotik

@someitguy2175

2 жыл бұрын

@@prostaknaivnyj5976 My boss pays me very well and allowed me to work from home to take care of my kids. Mikrotik can't do that for me.

The downsides I see to this are it's using 4 cores and only has 128 mb of storage, could easily throw in 1-4 GB of storage and bump the cpu to a Octa. Will the price increase? Obviously. Will server enthusiasts bite at it? Definitely

nice but...WINBOX DARK MODE!!!!

aw, looks like RouterOS is some proprietary thing, that's too bad…

@Rob2

2 жыл бұрын

With enough effort you can make other software run on it. It is not protected at the bootloader level (it is at the OS level so you cannot write your own modules). People ar running e.g. OpenWRT on (other) MikroTik hardware.

@sofia.eris.bauhaus

2 жыл бұрын

@@Rob2 thanks, that's good to know! :)

Субтитры на русском сложно что ли сделать?

I love RouterOS.. But it's 2022.. STOP selling new products with these 90% DEFECTIVE 10/100 PORTS!

@mikrotik

2 жыл бұрын

This device has 25G ports, what are you talking about?

@ForbiddenUser403

2 жыл бұрын

hEX Lite, hEX PoE lite, Powerbox, RB2011, hAP mini, hAP lite, hAP lite TC, mAP lite, cAP lite, mAP, hAP, wAP, wAP BE, wsAP, cAP, hAP ac lite, hAP ac lite TC, RB951, wAP R..... Is what i'm talking about. What? Do you have a warehouse full of 10/100 chips that you're trying to burn through before you have to throw them away? Does it really add THAT much more to the cost of these devices to include an ethernet port that's not 90% defective? I look over your product page, and I am just soo overwhelmed by how well you do with the software, and yet still selling items with 10/100 ports. I would be embarrassed to be selling a device with 10/100 port in 2022.

@guspaz

2 жыл бұрын

@@ForbiddenUser403 Those are mostly quite old products, and many modern devices still ship with 10/100 ports, such as pretty much all modern smart TVs, even the luxury OLED brands are still 10/100 ports.

@joergsonnenberger6836

Жыл бұрын

@@ForbiddenUser403 What's wrong with using a Fast Ethernet port for WLAN access points? In most real-world deployments, you won't get more than 100Mbit/s over the air anyway. Especially since most of the devices on that list don't do MIMO anyway.

something like this with qualcomm 4g & 5g gsm modem chip ?.