From nobody Thu Feb 12 22:05:47 2026 Received: from szxga02-in.huawei.com (szxga02-in.huawei.com [45.249.212.188]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4399414EC4F for ; Fri, 7 Jun 2024 04:31:06 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=45.249.212.188 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1717734668; cv=none; b=f0409WDziAJkJm8oxRVAU57X497v43BxpblVqCZu7VxlThstJ2JZsFIxTnxEAfJTVt/4r7MV9lKhZ7z5+Ke2XwobFxfXA0IksHhV32tvc5ZT5Awoqv3Mznina4JPgB9/jc+Vhg+OWYbc9wvI9zFj/KCLBbGIjmL7iZwcNHioQe0= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1717734668; c=relaxed/simple; bh=htZlLJFMjR5Uyxfrw6hi7XwHK37Sx94doRV08dDG2BE=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=I/1uHHkhoBrrurvhdHEdW3TNN0kR6yaeXsQPYUeShEP9xamh+McIHZ9kePcEvEgCPoFJistgiCyE/AUBSC1/+nDheCpSM62uN8bTjOUjQyEyT4XY7jXxbFoLtyysjCGFINNRR0wasWv++8l7rPib4onBYGiUppAmuV+bT4qUSrE= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=huawei.com; spf=pass smtp.mailfrom=huawei.com; arc=none smtp.client-ip=45.249.212.188 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=huawei.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=huawei.com Received: from mail.maildlp.com (unknown [172.19.88.105]) by szxga02-in.huawei.com (SkyGuard) with ESMTP id 4VwSnc5ZwkzmXhG; Fri, 7 Jun 2024 12:26:28 +0800 (CST) Received: from kwepemm600013.china.huawei.com (unknown [7.193.23.68]) by mail.maildlp.com (Postfix) with ESMTPS id 9BBF1140413; Fri, 7 Jun 2024 12:30:49 +0800 (CST) Received: from huawei.com (10.175.104.67) by kwepemm600013.china.huawei.com (7.193.23.68) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Fri, 7 Jun 2024 12:27:44 +0800 From: Zhihao Cheng To: , , , , , CC: , Subject: [RFC PATCH mtd-utils 105/110] tests: ubifs_tools: fsck_tests: Add random_corrupt+fsck test Date: Fri, 7 Jun 2024 12:26:10 +0800 Message-ID: <20240607042615.2069840-106-chengzhihao1@huawei.com> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20240607042615.2069840-1-chengzhihao1@huawei.com> References: <20240607042615.2069840-1-chengzhihao1@huawei.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: dggems706-chm.china.huawei.com (10.3.19.183) To kwepemm600013.china.huawei.com (7.193.23.68) Content-Type: text/plain; charset="utf-8" Inject random corruption on UBIFS image by writting random data on kinds of mtd devices (eg. nand, nor), check the consistency of UBIFS after fsck. This testcase simulates random bad UBIFS image caused by hardware exceptions(eg. ecc uncorrectable, unwritten), and makes sure that fsck.ubifs could make UBIFS be consistent after repairing UBIFS image. Signed-off-by: Zhihao Cheng --- .gitignore | 1 + configure.ac | 3 +- tests/ubifs_tools-tests/Makemodule.am | 3 +- .../fsck_tests/random_corrupted_fsck.sh.in | 206 +++++++++++++++++= ++++ 4 files changed, 211 insertions(+), 2 deletions(-) create mode 100755 tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsc= k.sh.in diff --git a/.gitignore b/.gitignore index 1d150f7a..203f01f0 100644 --- a/.gitignore +++ b/.gitignore @@ -119,6 +119,7 @@ tests/ubifs_tools-tests/fsck_tests/cycle_mount_fsck_che= ck.sh tests/ubifs_tools-tests/fsck_tests/powercut_fsck_mount.sh tests/ubifs_tools-tests/fsck_tests/cycle_corrupted_fsck_fault_inject.sh tests/ubifs_tools-tests/fsck_tests/cycle_powercut_mount_fsck.sh +tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsck.sh =20 # # Files generated by autotools diff --git a/configure.ac b/configure.ac index 1a7174a5..545fcc41 100644 --- a/configure.ac +++ b/configure.ac @@ -295,7 +295,8 @@ AC_CONFIG_FILES([tests/fs-tests/fs_help_all.sh tests/ubifs_tools-tests/fsck_tests/cycle_mount_fsck_check.sh tests/ubifs_tools-tests/fsck_tests/powercut_fsck_mount.sh tests/ubifs_tools-tests/fsck_tests/cycle_corrupted_fsck_fault_inject.sh - tests/ubifs_tools-tests/fsck_tests/cycle_powercut_mount_fsck.sh]) + tests/ubifs_tools-tests/fsck_tests/cycle_powercut_mount_fsck.sh + tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsck.sh]) =20 AC_OUTPUT([Makefile]) =20 diff --git a/tests/ubifs_tools-tests/Makemodule.am b/tests/ubifs_tools-test= s/Makemodule.am index 2c190e2b..9881ebbe 100644 --- a/tests/ubifs_tools-tests/Makemodule.am +++ b/tests/ubifs_tools-tests/Makemodule.am @@ -4,4 +4,5 @@ test_SCRIPTS +=3D \ tests/ubifs_tools-tests/fsck_tests/cycle_mount_fsck_check.sh \ tests/ubifs_tools-tests/fsck_tests/powercut_fsck_mount.sh \ tests/ubifs_tools-tests/fsck_tests/cycle_corrupted_fsck_fault_inject.sh \ - tests/ubifs_tools-tests/fsck_tests/cycle_powercut_mount_fsck.sh + tests/ubifs_tools-tests/fsck_tests/cycle_powercut_mount_fsck.sh \ + tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsck.sh diff --git a/tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsck.sh.in= b/tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsck.sh.in new file mode 100755 index 00000000..64760c94 --- /dev/null +++ b/tests/ubifs_tools-tests/fsck_tests/random_corrupted_fsck.sh.in @@ -0,0 +1,206 @@ +#!/bin/sh +# Copyright (c), 2024, Huawei Technologies Co, Ltd. +# Author: Zhihao Cheng +# +# Test Description: +# For many kinds of flash, do following things +# 1. mount UBIFS +# 2. fsstress && unmount +# 3. inject corruption into UBIFS image randomly +# 3. fsck UBIFS +# 4. check UBIFS mounting result +# Running time: 1h + +TESTBINDIR=3D@TESTBINDIR@ +source $TESTBINDIR/common.sh + +function run_test() +{ + local simulator=3D"$1"; + local size=3D"$2"; + local peb_size=3D"$3"; + local page_size=3D"$4"; + local encryption=3D$5; + + echo "=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D" + printf "%s" "$simulator: ${size}MiB PEB size ${peb_size}KiB" + if [ "$simulator" =3D "nandsim" ]; then + printf " %s" "page size ${page_size}Bytes" + fi + printf " $encryption\n" + + if [ "$simulator" =3D "nandsim" ]; then + $TESTBINDIR/load_nandsim.sh "$size" "$peb_size" "$page_size" || echo "ca= nnot load nandsim"; + mtdnum=3D"$(find_mtd_device "$nandsim_patt")" + elif [ "$simulator" =3D "mtdram" ]; then + load_mtdram "$size" "$peb_size" || echo "cannot load mtdram" + mtdnum=3D"$(find_mtd_device "$mtdram_patt")" + else + fatal "$simulator is not supported" + fi + + flash_eraseall /dev/mtd$mtdnum + modprobe ubi mtd=3D"$mtdnum,$page_size" || fatal "modprobe ubi fail" + ubimkvol -N vol_test -m -n 0 /dev/ubi$UBI_NUM || fatal "mkvol fail" + modprobe ubifs || fatal "modprobe ubifs fail" + mount_ubifs $DEV $MNT || fatal "mount ubifs fail" + if [[ "$encryption" =3D=3D "encrypted" ]]; then + encryption_gen_key + encryption_set_key $MNT + fi + + fsstress -d $MNT -l0 -p4 -n10000 & + + while true; + do + per=3D`df -Th | grep ubifs | awk '{print $6}'`; + if [[ ${per%?} -gt 95 ]]; then + # Used > 95% + break; + fi + done + + ps -e | grep -w fsstress > /dev/null 2>&1 + while [ $? -eq 0 ] + do + killall -9 fsstress > /dev/null 2>&1 + sleep 1 + ps -e | grep -w fsstress > /dev/null 2>&1 + done + + while true + do + res=3D`mount | grep "$MNT"` + if [[ "$res" =3D=3D "" ]] + then + break; + fi + umount $MNT + sleep 0.1 + done + + # injection + times=3D$((RANDOM % 10)) + let times=3D$times+10 + i=3D0 + tot_peb=3D`cat /sys/class/ubi/ubi$UBI_NUM/total_eraseblocks`; + + modprobe -r ubifs + modprobe -r ubi # Stop wear-leveling & erasing worker + while [[ $i -lt $times ]] + do + let i=3D$i+1; + peb=3D$((RANDOM % $tot_peb)); + pg=3D`expr $peb_size \* 1024`; + peb_off=3D`expr $pg \* $peb` + pages=3D`expr $pg / $page_size`; + pg=3D`expr $pages - 2`; + pg=3D$((RANDOM % $pg)); + pg_off=3D`expr $pg + 2`; + pg_start=3D`expr $pages \* $peb`; + pg=3D`expr $pg_start + $pg_off`; + vid_pg=3D`expr $pg_start + 1`; + dd if=3D/dev/mtd$mtdnum of=3D$TMP_FILE bs=3D$page_size skip=3D$vid_pg co= unt=3D1 2>/dev/null; + content=3D`cat $TMP_FILE | grep UBI!`; # vid header magic + if [[ "$content" =3D=3D "" ]]; then + # Skip free PEB, otherwise data could be overwritten in UBIFS + continue; + fi + if [[ $((RANDOM % 2)) =3D=3D 0 ]]; then + # Corrupts 1 page + dd if=3D/dev/urandom of=3D/dev/mtd$mtdnum bs=3D$page_size seek=3D$pg co= unt=3D1; + else + # Erase 1 LEB, TNC points to an unmapped area + flash_erase /dev/mtd$mtdnum $peb_off 1 + fi + done + rm -f $TMP_FILE 2>/dev/null + sync + + skip=3D0 + modprobe ubi mtd=3D"$mtdnum,$page_size" + ret=3D$? + if [[ $ret !=3D 0 ]] + then + skip=3D1 + echo "UBI layout volume is corrupted, skip" + fi + + if [[ $skip =3D=3D 0 ]]; then + modprobe ubifs || fatal "modprobe ubifs2 fail" + dmesg -c > /dev/null + fsck.ubifs -yb $DEV 2>&1 > $LOG_FILE + res=3D$? + cat $LOG_FILE + let "ret=3D$res&~$FSCK_NONDESTRUCT" + if [[ $ret !=3D $FSCK_OK ]] + then + # Skip superblock error + log=3D`cat $LOG_FILE | grep "bad node at LEB 0:"` + if [[ "$log" !=3D "" ]] + then + skip=3D1 + echo "SB is corrupted, skip fsck & mounting" + else + fatal "fsck fail $res" + fi + fi + + if [[ $skip =3D=3D 0 ]]; then + enable_chkfs + + mount_ubifs $DEV $MNT "noauthentication" "noatime" + res=3D$? + if [[ $res !=3D 0 ]] + then + fatal "mount fail $res" + fi + + if [[ "$encryption" =3D=3D "encrypted" ]]; then + # Ignore the encrypting error, root dir could be + # corrupted, the new root dir cannot be + # encrypted because it is not empty. + encryption_set_key $MNT 1 + fi + + du -sh $MNT > /dev/null # Make sure all files are accessible + ret=3D$? + if [[ $ret !=3D 0 ]]; then + fatal "Cannot access all files" + fi + # check_err_msg is not suggested in this testcase, because + # ubi_io_read(triggered by wear_leveling_worker -> ubi_eba_copy_leb) + # could print stack if ecc uncorrectable errors are detected. + + umount $MNT + res=3D$? + if [[ $res !=3D 0 ]] + then + fatal "unmount fail $res" + fi + fi + modprobe -r ubifs + modprobe -r ubi + fi + modprobe -r $simulator + + echo "-------------------------------------------------------------------= ---" +} + +check_fsstress +start_t=3D$(date +%s) +echo "Do random_corrruption+fsck+mount test in kinds of flashes" +for simulator in "mtdram" "nandsim"; do + for encryption in "encrypted" "noencrypted"; do + run_test "$simulator" "16" "16" "512" $encryption + run_test "$simulator" "64" "16" "512" $encryption + run_test "$simulator" "128" "64" "2048" $encryption + run_test "$simulator" "256" "128" "2048" $encryption + run_test "$simulator" "512" "128" "2048" $encryption + run_test "$simulator" "1024" "512" "2048" $encryption + done +done +end_t=3D$(date +%s) +time_cost=3D$(( end_t - start_t )) +echo "Success, cost $time_cost seconds" +exit 0 --=20 2.13.6