ANDROID ROM TEST v1.0 Evo 3D
**************************************
The purpose of this is to create a cut and dry template to develope, test, and troubleshoot ROMs. This provides the users and developers the ability to test key functions of their phone to verify functionality and stability of functions (small and large) based on an organized series of tests. When I have some time, I will also go through it and add notes to help troubleshoot issues (based on my own experience and other's) so the user can (hopefully) solve a problem on their own and learn along the way. I'll also do the best I can do discuss why a given problem occurs (this is also where the rest of you can provide very useful information as well).
**NOTE********************************
There are more little odd-end tests that I run on the ROMs I install on my phone. But this is a basic breakdown. When a ROM passes all of these tests, I conclude to myself that it is extremely stable and I can rely completely on it to work 100% of the time. I will update this more tomorrow. It's late and I have to work in 4 hours lol. Feel free to distribute this or use it, modify it, add to it, however you feel. Dev's are more than welcome to use this and add to it. As I add more, and all of you add more, I want this to become a very in depth, micro-analysis/test
template for our ROMs. Eventually, and as we develope this more, we can use it as a very accurate check-list to determine complete and total stability of a ROM. I tried to organize it as best I could based on what functions should be tested and in what order (first to last) based on priority and logic. Please give your input.
**********************************************************************************************************
I have attached a .txt file to this post so you can download this write-up, change it, modify it to your liking, add things to it that you think are better... whatever you do with it, if you have something you have added that could benefit everybody else all I ask is to please share the useful information
Let's begin...
ANTENNAS AND PERMISSIONS (ROOT)
-verify 3G and 4G antennas are functional and transmitting data properly. Browse internet on both 3G and 4G. Sync your accounts, verify contacts, access market, and download an application on both 3G and 4G settings.Download app that requires root access. Download cache cleaner NG, and My backup root (if not included in your rom). You will need both of these later to test other functions.
*****note, sometimes general issues occur with apps, and accounts, and you are not able to sync them for unknown reasons. Double check passwords, and if that does not work, boot to recovery and do a factory reset or flash a .zip to format your data. This has worked for me several times when encountering these types of errors. This is sometimes applicable to applications in general but be cautious of what apps/programs you decide to wipe data from.
-verify root access. Open cache cleaner and my backup root. You should be prompted to allow super user permissions. Afterwards, open up super-user application and verify events are being logged, and that apps are indeed being saved as being "allowed" permissions.
*****note that sometimes problems can occur with your system permissions and how your system is mounted. If you are being denied access to root, try powering down the phone, booting to recovery and navigating to and selecting "FIX PERMISSIONS" then boot back up. This usually works for me and most others.
-verify phone can make calls, receive calls, and call voicemail with no issues. To do a basic check of system stability, turn screen off and on manually by hitting the power button while in a phone call.
-Browse around settings, apps, and perform basica multi-tasking functions to ensure phone stability during a call.
-Verify both callers can hear each other.
-Verify volume rocker adjusts in-call volume appropriately.
-Verify speaker phone is operating properly.
-Verify proximity sensors are working in phone call (screen shuts off with an object in front of the sensor [located at the top of the phone near ear speaker])
-Verify GPS and network location antennas are working by enabling them and opening google maps. Verify accurate location and compass direction.
-Verify wifi is working and stable by connecting to a home-based internet connection and browsing the web.
-Verify bluetooth is fucntional and stable by connecting to a bluetooth device.
-Verify "update profile" is functional under settings>system updates **do not update anything else***
-Verify wifi hot spot is functional
SMS, MMS
-verify phone can receive and send text messages and multimedia messages. Send both group and individual messages. Perform these tasks while in a phone call (note that MMS messages will only be allowed from 4G if you are in a phone call as 3G gets disabled).
-Verify MMS function has no issues sending various types of media such as sound clips, recordings, videos, and pictures. Verify camera works properly from the SMS/MMS application.
-Verify keyboard is working properly and accurately. If keyboard seems to be inaccurate, try navigating to settings>langauge and keyboard>touch input>text input and calibrate the keyboard. Also, try disabling vibrate while typing to have a little bit smoother operation if you have quick thumbs
CAMERA
-verify camera has no issues capturing various types of media such as pictures and video recordings.
-Verify the resolution selected for said recordings is the one recorded by navigating to SD card via a file explorer (Root Explorer, ES File Explorer, etc.) and checking properties of recorded media.
-Verify sound is working on selected media where sound is applicable.
-Verify indicated special features of camera (as indicated by your ROM dev) are functioning as they should.
-Verify the 3D function is working properly and that media is appearing in 3D when viewed.
MEDIA
-verify all downloaded/installed media is functioning properly and being utilized by the system properly by moving various apps back and forth from SD card with no errors.
-Verify drivers are being detected by computer (sometimes if errors are found here, you can fix it by simply disconnecting phone and reconnecting or by restarting the computer).
-Verify external storage (SD card) is being detected by the system in settings. Verify phone can properly mount to a computer as storage and charge only.
-Verify pictures can be viewed by gallery application and "x" file explorer with no errors.
-Verify native screenshot function is functional and that such media is viewable via SMS, gallery, and "x" file explorer.
-Verify youtube, FB, and all other media applications (where applicable to you) are allowing media uploads directly from your device.
SOUND
-verify sound is working throughout the device. Check notifications (Gmail, SMS, MMS), media sound, incoming phone calls, and most importantly your alarms. Set multiple alarms for various times throughout the day, with different types of ringones such as a music file, a stock ringtone, and downloaded ringtone.
-Verify volume rocker adjusts volume properly for phone volume and media volume.
-Verify different types of media are playing through speakers and through headphone output. Check MP3's, games, videos, and web-based media such as youtube with this criteria.
-Verify haptic feedback is functional and vibrate mode is also functional.
BASIC ANDROID SYSTEM FUNCTIONALITY
-Verify the following functions are working:
*blinking LED's for notifications
*auto rotation
*auto brightness/manual brightness settings
*long press home button (this should bring up your recently used apps. This function can be performed at any time, on any screen, regardless of what app or task you are performing.)
*long press search button (this should bring up your voice recognition)
*from home screen, tap search button (this should bring up google search. You can search internet or installed applications from this function.)
*camera hard button
HEAVY MULTI-TASKING (these are just some I like to do)
-while in a phone call, open up my backup root and perform a full data backup, and a full applications backup. After initializing backup, connect to 4G and browse around the web. Periodically check status of backup by long pressing the soft home key on your phone and selecting my backup root. When it is
finished, open up root explorer, or another capable file manager, and extract (decomress) a .zip file. I like to use ROM.zips for this as they tax the system pretty hard for resources. After that finishes, send an email with a video attached to it. While all of these are happening, engage in a SMS conversation. Eat it iPhone.
SYSTEM LONGEVITY AND SELF MANAGEMENT
-Run phone for a week without shutting it off or powering it off and with no reboots.
That's it for now. Off to bed. Let's get as much information in here as possible. Tomorrow I will include various problems I have encountered when flashing ROMs, kernels, etc., and how to troubleshoot such issues.
Originally found on xda website all credit goes to cobraboy85
Sent from my clean sharp shooter
**************************************
The purpose of this is to create a cut and dry template to develope, test, and troubleshoot ROMs. This provides the users and developers the ability to test key functions of their phone to verify functionality and stability of functions (small and large) based on an organized series of tests. When I have some time, I will also go through it and add notes to help troubleshoot issues (based on my own experience and other's) so the user can (hopefully) solve a problem on their own and learn along the way. I'll also do the best I can do discuss why a given problem occurs (this is also where the rest of you can provide very useful information as well).
**NOTE********************************
There are more little odd-end tests that I run on the ROMs I install on my phone. But this is a basic breakdown. When a ROM passes all of these tests, I conclude to myself that it is extremely stable and I can rely completely on it to work 100% of the time. I will update this more tomorrow. It's late and I have to work in 4 hours lol. Feel free to distribute this or use it, modify it, add to it, however you feel. Dev's are more than welcome to use this and add to it. As I add more, and all of you add more, I want this to become a very in depth, micro-analysis/test
template for our ROMs. Eventually, and as we develope this more, we can use it as a very accurate check-list to determine complete and total stability of a ROM. I tried to organize it as best I could based on what functions should be tested and in what order (first to last) based on priority and logic. Please give your input.
**********************************************************************************************************
I have attached a .txt file to this post so you can download this write-up, change it, modify it to your liking, add things to it that you think are better... whatever you do with it, if you have something you have added that could benefit everybody else all I ask is to please share the useful information
Let's begin...
ANTENNAS AND PERMISSIONS (ROOT)
-verify 3G and 4G antennas are functional and transmitting data properly. Browse internet on both 3G and 4G. Sync your accounts, verify contacts, access market, and download an application on both 3G and 4G settings.Download app that requires root access. Download cache cleaner NG, and My backup root (if not included in your rom). You will need both of these later to test other functions.
*****note, sometimes general issues occur with apps, and accounts, and you are not able to sync them for unknown reasons. Double check passwords, and if that does not work, boot to recovery and do a factory reset or flash a .zip to format your data. This has worked for me several times when encountering these types of errors. This is sometimes applicable to applications in general but be cautious of what apps/programs you decide to wipe data from.
-verify root access. Open cache cleaner and my backup root. You should be prompted to allow super user permissions. Afterwards, open up super-user application and verify events are being logged, and that apps are indeed being saved as being "allowed" permissions.
*****note that sometimes problems can occur with your system permissions and how your system is mounted. If you are being denied access to root, try powering down the phone, booting to recovery and navigating to and selecting "FIX PERMISSIONS" then boot back up. This usually works for me and most others.
-verify phone can make calls, receive calls, and call voicemail with no issues. To do a basic check of system stability, turn screen off and on manually by hitting the power button while in a phone call.
-Browse around settings, apps, and perform basica multi-tasking functions to ensure phone stability during a call.
-Verify both callers can hear each other.
-Verify volume rocker adjusts in-call volume appropriately.
-Verify speaker phone is operating properly.
-Verify proximity sensors are working in phone call (screen shuts off with an object in front of the sensor [located at the top of the phone near ear speaker])
-Verify GPS and network location antennas are working by enabling them and opening google maps. Verify accurate location and compass direction.
-Verify wifi is working and stable by connecting to a home-based internet connection and browsing the web.
-Verify bluetooth is fucntional and stable by connecting to a bluetooth device.
-Verify "update profile" is functional under settings>system updates **do not update anything else***
-Verify wifi hot spot is functional
SMS, MMS
-verify phone can receive and send text messages and multimedia messages. Send both group and individual messages. Perform these tasks while in a phone call (note that MMS messages will only be allowed from 4G if you are in a phone call as 3G gets disabled).
-Verify MMS function has no issues sending various types of media such as sound clips, recordings, videos, and pictures. Verify camera works properly from the SMS/MMS application.
-Verify keyboard is working properly and accurately. If keyboard seems to be inaccurate, try navigating to settings>langauge and keyboard>touch input>text input and calibrate the keyboard. Also, try disabling vibrate while typing to have a little bit smoother operation if you have quick thumbs
CAMERA
-verify camera has no issues capturing various types of media such as pictures and video recordings.
-Verify the resolution selected for said recordings is the one recorded by navigating to SD card via a file explorer (Root Explorer, ES File Explorer, etc.) and checking properties of recorded media.
-Verify sound is working on selected media where sound is applicable.
-Verify indicated special features of camera (as indicated by your ROM dev) are functioning as they should.
-Verify the 3D function is working properly and that media is appearing in 3D when viewed.
MEDIA
-verify all downloaded/installed media is functioning properly and being utilized by the system properly by moving various apps back and forth from SD card with no errors.
-Verify drivers are being detected by computer (sometimes if errors are found here, you can fix it by simply disconnecting phone and reconnecting or by restarting the computer).
-Verify external storage (SD card) is being detected by the system in settings. Verify phone can properly mount to a computer as storage and charge only.
-Verify pictures can be viewed by gallery application and "x" file explorer with no errors.
-Verify native screenshot function is functional and that such media is viewable via SMS, gallery, and "x" file explorer.
-Verify youtube, FB, and all other media applications (where applicable to you) are allowing media uploads directly from your device.
SOUND
-verify sound is working throughout the device. Check notifications (Gmail, SMS, MMS), media sound, incoming phone calls, and most importantly your alarms. Set multiple alarms for various times throughout the day, with different types of ringones such as a music file, a stock ringtone, and downloaded ringtone.
-Verify volume rocker adjusts volume properly for phone volume and media volume.
-Verify different types of media are playing through speakers and through headphone output. Check MP3's, games, videos, and web-based media such as youtube with this criteria.
-Verify haptic feedback is functional and vibrate mode is also functional.
BASIC ANDROID SYSTEM FUNCTIONALITY
-Verify the following functions are working:
*blinking LED's for notifications
*auto rotation
*auto brightness/manual brightness settings
*long press home button (this should bring up your recently used apps. This function can be performed at any time, on any screen, regardless of what app or task you are performing.)
*long press search button (this should bring up your voice recognition)
*from home screen, tap search button (this should bring up google search. You can search internet or installed applications from this function.)
*camera hard button
HEAVY MULTI-TASKING (these are just some I like to do)
-while in a phone call, open up my backup root and perform a full data backup, and a full applications backup. After initializing backup, connect to 4G and browse around the web. Periodically check status of backup by long pressing the soft home key on your phone and selecting my backup root. When it is
finished, open up root explorer, or another capable file manager, and extract (decomress) a .zip file. I like to use ROM.zips for this as they tax the system pretty hard for resources. After that finishes, send an email with a video attached to it. While all of these are happening, engage in a SMS conversation. Eat it iPhone.
SYSTEM LONGEVITY AND SELF MANAGEMENT
-Run phone for a week without shutting it off or powering it off and with no reboots.
That's it for now. Off to bed. Let's get as much information in here as possible. Tomorrow I will include various problems I have encountered when flashing ROMs, kernels, etc., and how to troubleshoot such issues.
Originally found on xda website all credit goes to cobraboy85
Sent from my clean sharp shooter
Facebook
Twitter
Instagram