Archive for October, 2020

Extending ext4 filesystem inside a VMware guest

VMware guest is running Kali Linux, but the procedure is same for any distro – CentOS, RedHat, or Ubuntu, as filesystem extension is ext4.

And so here I will approached it mainly via using “gparted”.

First shutdown the OS, and use VMware setting to increase the diskspace via “expand disk” option.

image 4

After selecting “Expand Disk” VMware will increase the filesize of the VMDK file in the host machine – make sure you have sufficient space for that:

image 5

After expansion, bootup the OS and issue “fdisk” to see the new size:

As noted above, the new physical size is 40G, but the total allocated (by adding up all the start to end sectors and multiply by 512 bytes and you get 20G.

So now to extend the disk, you will need to remove the “Extended” and “Swap” partition, and followed by “resize2fs” command as shown in articles below:

http://www.uptimemadeeasy.com/vmware/grow-an-ext4-filesystem-on-a-vmware-esxi-virtual-machine/

https://serverfault.com/questions/509468/how-to-extend-an-ext4-partition-and-filesystem

http://manpages.ubuntu.com/manpages/xenial/man8/resize2fs.8.html

But an easier way is to use “gparted”:

Starting “sudo gparted /dev/sda”:

First is disable the swapspace, and delete the swap partition, and then “extended” partition:

Delete the swap partition:

Now deleting the “extended” partition:

And now you get the two unallocated partition combined into one:

Now select the “/dev/sda” partition for resizing:

After specifying the new size, select “apply all operation”:

This is what you will end up with after resizing:

Command buffer error: drivers/gpu/drm/vmwgfx/vmwgfx_cmdbuf.c:399

Just a record of what happened – and this is happening in the VMware running Kali Linux as guest (and host is Ubuntu 18.04):

[    6.061586] Bridge firewalling registered
[    6.173128] Initializing XFRM netlink socket
[    7.832786] ————[ cut here ]————
[    7.832787] Command buffer error.
[    7.832829] WARNING: CPU: 0 PID: 146 at drivers/gpu/drm/vmwgfx/vmwgfx_cmdbuf.c:399 vmw_cmdbuf_ctx_process+0x26e/0x280 [vmwgfx]
[    7.832829] Modules linked in: xt_conntrack(E) xt_MASQUERADE(E) nf_conntrack_netlink(E) xfrm_user(E) xfrm_algo(E) nft_counter(E) xt_addrtype(E) nft_compat(E) nft_chain_nat(E) nf_nat(E) nf_conntrack(E) nf_defrag_ipv6(E) nf_defrag_ipv4(E) libcrc32c(E) nf_tables(E) nfnetlink(E) br_netfilter(E) bridge(E) stp(E) llc(E) rfkill(E) overlay(E) vmw_balloon(E) joydev(E) pcspkr(E) snd_ens1371(E) serio_raw(E) snd_ac97_codec(E) ac97_bus(E) gameport(E) snd_rawmidi(E) snd_seq_device(E) snd_pcm(E) snd_timer(E) snd(E) soundcore(E) sg(E) evdev(E) ac(E) vsock_loopback(E) vmw_vsock_virtio_transport_common(E) vmw_vsock_vmci_transport(E) vsock(E) vmw_vmci(E) binfmt_misc(E) fuse(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) ext4(E) crc16(E) mbcache(E) jbd2(E) crc32c_generic(E) sd_mod(E) t10_pi(E) crc_t10dif(E) crct10dif_generic(E) hid_generic(E) usbhid(E) hid(E) crct10dif_pclmul(E) crct10dif_common(E) crc32_pclmul(E) crc32c_intel(E) sr_mod(E) cdrom(E) ata_generic(E) ghash_clmulni_intel(E) aesni_intel(E)
[    7.832846]  libaes(E) crypto_simd(E) cryptd(E) glue_helper(E) vmwgfx(E) psmouse(E) ttm(E) ata_piix(E) drm_kms_helper(E) cec(E) libata(E) ehci_pci(E) e1000(E) uhci_hcd(E) ehci_hcd(E) usbcore(E) usb_common(E) mptspi(E) mptscsih(E) mptbase(E) scsi_transport_spi(E) drm(E) i2c_piix4(E) scsi_mod(E) button(E)
[    7.832857] CPU: 0 PID: 146 Comm: irq/16-vmwgfx Tainted: G            E     5.7.0-kali1-amd64 #1 Debian 5.7.6-1kali2
[    7.832857] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
[    7.832861] RIP: 0010:vmw_cmdbuf_ctx_process+0x26e/0x280 [vmwgfx]
[    7.832863] Code: 48 8b 44 24 30 83 00 01 48 83 c4 38 5b 5d 41 5c 41 5d 41 5e 41 5f c3 48 c7 c7 76 60 40 c0 c6 05 ce 1f 03 00 01 e8 44 b9 09 f3 <0f> 0b e9 11 fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00
[    7.832863] RSP: 0018:ffffa83800847dc8 EFLAGS: 00010282
[    7.832864] RAX: 0000000000000000 RBX: ffff919a9f0ef480 RCX: 0000000000000007
[    7.832864] RDX: 0000000000000007 RSI: 0000000000000086 RDI: ffff919afbe19ac0
[    7.832864] RBP: ffff919a9f0ef488 R08: 00000000000005ec R09: 0000000000000004
[    7.832865] R10: 0000000000000000 R11: 0000000000000001 R12: ffff919af7211d18
[    7.832865] R13: ffff919a9f0ef668 R14: ffff919af7211d00 R15: 0000000000000003
[    7.832866] FS:  0000000000000000(0000) GS:ffff919afbe00000(0000) knlGS:0000000000000000
[    7.832866] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    7.832867] CR2: 00007f7ef3800000 CR3: 0000000070b3a000 CR4: 00000000003406f0
[    7.832885] Call Trace:
[    7.832893]  ? irq_finalize_oneshot.part.0+0x100/0x100
[    7.832897]  vmw_cmdbuf_man_process+0x55/0xf0 [vmwgfx]
[    7.832900]  vmw_cmdbuf_irqthread+0x22/0x30 [vmwgfx]
[    7.832904]  vmw_thread_fn+0x32/0x70 [vmwgfx]
[    7.832906]  irq_thread_fn+0x20/0x60
[    7.832907]  irq_thread+0xdc/0x170
[    7.832908]  ? irq_forced_thread_fn+0x80/0x80
[    7.832910]  kthread+0xf9/0x130
[    7.832911]  ? irq_thread_check_affinity+0xd0/0xd0
[    7.832912]  ? kthread_park+0x90/0x90
[    7.832915]  ret_from_fork+0x22/0x40
[    7.832916] —[ end trace fce1fb50f8f5ffd0 ]—
Frankly I am not sure what is happening.   Command buffer error coming from VMware drivers – sound like a bug not as thoroughly tested as the main kernel.

Ever experience a harddisk crash before?

Today I saw lots of these:

In fact I have been ignoring it past few days. Never did I suspect the harddisk is going to crash soon. Until my VMware managed to boot up, and everything rendered properly, except it is not responding to any mouse control.

And so now a major operation of migration is starting now.

LIBXML2_LIBRARY LIBXML2_INCLUDE_DIR errors

While compiling LLVM version 12.0.0 I encountered:

— pstl project is disabled
— flang project is disabled
— Could NOT find LibXml2 (missing: LIBXML2_LIBRARY LIBXML2_INCLUDE_DIR)
— Native target architecture is X86
— Threads enabled.
— Doxygen disabled.
— Go bindings disabled.
— Could NOT find OCaml (missing: OCAMLFIND OCAML_VERSION OCAML_STDLIB_PATH)
— Could NOT find OCaml (missing: OCAMLFIND OCAML_VERSION OCAML_STDLIB_PATH)
— OCaml bindings disabled.
— LLVM host triple: x86_64-unknown-linux-gnu
— LLVM default target triple: x86_64-unknown-linux-gnu
— Building with -fPIC
 
According to:
 
 
I guessed the remedy and got it working:
 
— parallel-libs project is disabled
— polly project is enabled
— pstl project is disabled
— flang project is disabled
— Found LibXml2: /usr/lib/x86_64-linux-gnu/libxml2.so (found version “2.9.4”)
— Looking for xmlReadMemory
— Looking for xmlReadMemory – found
— Native target architecture is X86
— Threads enabled.
— Doxygen disabled.
— Go bindings disabled.
— Found OCaml: /usr/bin/ocamlfind  
— OCaml bindings disabled, need ctypes >=0.4.
— LLVM host triple: x86_64-unknown-linux-gnu
— LLVM default target triple: x86_64-unknown-linux-gnu
— Building with -fPIC
 
The remedy is:
 
sudo apt-get install libxml2-dev
sudo apt-get install opam ocaml-interp

Files missing in /lib/firmware/amdgpu/ issues

I encountered this problem while generating kernel today:

W: Possible missing firmware /lib/firmware/amdgpu/arcturus_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_ce.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_pfp.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_me.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_ce.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_pfp.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_me.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_ce.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_pfp.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_me.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_ce.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_pfp.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_me.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_mec.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_mec2.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_rlc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_sdma1.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_sdma.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi10_mes.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_mes.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/tahiti_uvd.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/verde_uvd.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/pitcairn_uvd.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/oland_uvd.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/sienna_cichlid_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navy_flounder_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/renoir_dmcub.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_dmcu.bin for module amdgpu
run-parts: executing /etc/kernel/postinst.d/pm-utils 5.9.0+ /boot/vmlinuz-5.9.0+
run-parts: executing /etc/kernel/postinst.d/unattended-upgrades 5.9.0+ /boot/vmlinuz-5.9.0+
run-parts: executing /etc/kernel/postinst.d/update-notifier 5.9.0+ /boot/vmlinuz-5.9.0+
run-parts: executing /etc/kernel/postinst.d/zz-update-grub 5.9.0+ /boot/vmlinuz-5.9.0+
Sourcing file `/etc/default/grub’

The answer is "SOLVED" here:

https://www.linux.org/threads/files-missing-in-lib-firmware-amdgpu-solved.30836/

And it solved it by totally ignoring the errors. The reason why the errors is flagged is because of dependencies being flagged by amdgpu, and it just ignored it. Amazing solution.

My suggestion is trying out the answer at:

https://github.com/Umio-Yasuno/unofficial-amdgpu-firmware-repo

Vickblöm

Research scattered with thoughts, ideas, and dreams

Penetration Testing Lab

Offensive Techniques & Methodologies

Astr0baby's not so random thoughts _____ rand() % 100;

@astr0baby on Twitter for fresh randomness

The Data Explorer

playing around with open data to learn some cool stuff about data analysis and the world

Conorsblog

Data | ML | NLP | Python | R

quyv

Just a thought

IFT6266 - H2017 Deep Learning

A Graduate Course Offered at Université de Montréal

Deep Learning IFT6266-H2017 UdeM

Philippe Paradis - My solutions to the image inpainting problem

IFT6266 – H2017 DEEP LEARNING

Pulkit's thoughts on the course project

Thomas Dinsmore's Blog

No man but a blockhead ever wrote except for money -- Samuel Johnson

the morning paper

a random walk through Computer Science research, by Adrian Colyer

The Spectator

Shakir's Machine Learning Blog